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Foreword 


This final report covers the work performed under Contract 
NAS-3-18907 from July 1974 to September 1975. The study 
was accomplished by General D 5 mamics Corporation, Fort Worth 
Division, Fort Worth, Texas and Vanderbilt University, Nashville 
Tennessee. The program was managed by Dr„ B. G. W, Yee of 
General Dynamics, with Dr, J„ C. Couchman and Dr, F. H, Chang 
serving as principal investigators. Valuable contributions were 
made to the development of the statistical analysis by Dr, G, H, 
Lemon and computer programming by J, S, Kunselman and T. Walker, 
Dr. P. F, Packman of Vanderbilt University served as associate 
program manager. The program was under the technical direction 
of Mr. S, J, Klima, NASA Lewis Research Center, Cleveland, Ohio, 

Participants in this program are indebted to many people 
in the NDE community for furnishing data to this program and 
for providing consultation. 
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SUMMARY 


The overall objective of this program is to assess 
available nondestructive testing data for the determination 
of the sensitivity and reliability of state-of-the-art 
production NDE methods for flaw detection on metallic ma- 
terials. This program was separated into four different 
tasks. They Were: 

Task I Acquisition of Information 

Task II Screening and Separation of 

Data by NDE Method and Ma- 
terial 


Task III Statistical Determination of 

NDE Reliability 


Task IV 


Reporting 


Twenty sets of relevant NDE reliability data have been 
identified, collected, compiled, and categorized. Three 
relevant on-going programs have also been identified. A 
criterion for the selection of data for statistical analysis 
considerations has been formulated. A model to grade the 
quality and validity of the data sets has been developed. 

Data input formats, which record the pertinent parameters 
of the defect /specimen and inspection procedures, have been 
formulated for each NDE method. A comprehensive computer 
program has been written to calculate the probability of 
flaw detection at several confidence levels by the binomial 
distribution. This program also selects the desired data 
sets for pooling, and tests the statistical pooling criteria 
before calculating the composite detection reliability. 
Probability of detection curves at 95 and 50 percent con- 
fidence levels have been plotted by NDE technique and ma- 
terial type for individual sets of data as well as for merged 
data. 
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INTRODUCTION 


In order to apply linear-elastic fracture mechanics to 
structural design, NDE has to show at a high level of con- 
fidence that no flaw larger than a specific size exists in 
the structure. To establish the minimum detectable flaw 
size, many companies and organizations have conducted NDE 
demonstration programs. Most of these demonstration programs 
have been conducted in the production and fie Id- service environ- 
ment, but some have been conducted in the laboratory environ- 
ment . 


The results obtained from demonstration programs are 
lacking in universal agreement. This lack of agreement is 
not surprising because each company or organization may use 
a different NDE procedure, different personnel, different 
procedures and parameters to generate the test flaws, different 
flaws and material types, and even different statistical ana- 
lysis procedures. There appears to be a need to (1) collect 
much of the available NDE reliability data, (2) closely examine 
all the parameters that could affect the detection reliability, 
(3) compare the parameters used by each organization to obtain 
the data, and (4) attempt to identify the parameters that most 
likely cause observable differences in detection reliability. 

It appears worthwhile to obtain a composite detection relia- 
bility for each NDE method, material t 3 rpe, and flaw t 5 rpe by 
pooling data obtained from several sources. At the same time, 
the merits and shortcomings of several statistical analysis 
procedures should be carefully examined and the procedure most 
suitable for the analysis of NDE reliability data should be 
selected. Any needs for improved methods should be identified. 

The program reported on in this document was intended to 
collect all available NDE data, screen and separate the data by 
NDE method and material, perform statistical analyses, and 
evaluate the state-of-the-art in NDE reliability. 
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II. ACQUISITION OF INFORMATION 


The acquisition of NDE reliability related data, identifi- 
cation of on-going programs, and preparation of a bibliography 
of the acquired data is discussed in this section. 

2.1 Acquisition of NDE Reliability Related Data 

Twenty- three sets of potentially useful data have been 
identified during this program and twenty sets were acquired. 
Three sets of data involve on-going programs and the data were 
not made available for inclusion in this study. Of the twenty 
sets of data received, only seven sets were statistically 
analyzed. The thirteen sets of data that were not statisti- 
cally analyzed were rejected because they did not satisfy the 
selection criterion discussed in Section III of this report or 
the owner refused to permit the data to be used. 

2.2 Bibliography 

The twenty sets of NDE reliability related data that 
have been acquired are listed below. Some of the references 
are private data in which case only company or committee report 
numbers are available. Several references to government funded 
programs, which have not been published can only be identified 
by sponsoring agencies and the name of an individual at the 
company where the work was conducted. Copies of these data 
can be obtained by either contacting an individual within the 
sponsoring agency or an individual associated with the company. 
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2.3 On-Going Programs 

There are several on-going programs that are currently 
known. Of these, only three are government funded and their 
results will be available to the public for analysis. The 
data from the privately funded programs may never be made 
available for public analysis. 

The three government funded on-going programs are: 

1. Crack detection reliability on welded plates and 
structures, Martin Marietta, Ward Rummel, sponsored 
by NASA/Johnson Space Center, NAS 9-13578. 

2. Crack detection reliability on actual aircraft 
structures at the depot level, Lockheed, GA, , 

W. Lewis, sponsored by Kelly Air Force Base. 

3. Crack detection reliability on bolt holes on F-111 
fatigue tested structures. General D 5 mamics, Fort Worth 
Division, B, G, W, Yee, Sponsored by SMALC. 
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III. SCREENING AND SEPARATION OF DATA BY 
NDE METHOD AND MATERIAL 


This section describes the development of data selection 
criteria, separation and categorization of data, development 
of a model to grade quality of the data, and the development 
of a data input format for each NDE method. 

3,1 Criteria for Selection of Data for Statistical Analysis 

All of the reliability related NDE data are not necessarily 
suitable for statistical analysis. Some are lacking in the 
documentation of certain key pertinent parameters, such as the 
defect dimension, defect type, NDE method, etc. Statistical 
analysis of data when the key pertinent parameters are not 
documented would be marginal in value. A data selection 
criteria is needed to screen the data and prejudge the suitability 
of the data for statistical analysis. Such a criteria is 
necessarily subjective because it involves human judgment of 
data value or usefulness. It is felt that such a subjective 
criteria will still be useful to screen out data having margi- 
nal statistical value and to eliminate lost time in processing 
the data. 

To be eligible for statistical analysis, a set of data 
must satisfy the following conditions: 

a) An NDE procedure or specification must accompany the 
data which clearly describes the equipment and the 
parameters used so that the data may be reproduced 
in other facilities (assuming the same equipment or 
its equivalent is used) . 

b) The defect dimensions and specimen geometry must be 
well documented so that data may be statistically 
analyzed and compared to defect detection in the 
proper defect size range. When artificial methods 
of defect fabrication are used, at least ten percent 
(10%) of all defects in a given set must be destruc- 
tively tested to obtain the defect dimensions. For 
methods that are used to produce multiple defects in 
a specimen or methods that are questionable for 
producing controllable defect dimensions, at least 
fifty percent (50%) of all defects in a given set 
must be destructively tested to verify the defect 
dimensions . 
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The model that was developed to grade the quality of the 
data was very subjective. It consisted of assigning weighting 
factors and summing up the weighting factors to obtain an overall 
factor that is an index of data quality. The model is in- 
cluded in Appendix A. 

Data pooling tests that were coded in the NASA data pro- 
cessing code (reproduced in Appendix B) provided a means for 
isolating input errors and identifying any data set that may 
be suspect. The tests are derived from binomial statistics 
equations which are developed in the next section. 

The computer code developed for processing the NDE relia- 
bility data is described in Appendix C. Included is a complete 
description of data input formats and parameter keys. 

3.2 Separation and Categorization of Data Sets 

The twenty sets of data listed in the Bibliography in 
Subsection 2.2 can be separated into three categories. Table 
3-1 describes the data separated into the three categories and 
the status of these data sets. The first category is the data 
that appear to satisfy the criteria discussed in Subsection 
3.1, and they will be considered for statistical analysis. 

There are seven (7) sets of data in this category. The second 
category is data that probably could be used if permission to 
use the data is granted by the rightful owner of the data. There 
are two sets of data in this category. The third category is the 
data that are either lacking in the inspection procedure docu- 
mentation or defect dimension documentation. There are eleven sets 
of data in this category. The data sets in each of the three 
categories are presented in Table 3-1. 

A large majority of the data were obtained on thin flat 
plates which contain fatigue cracks or weld defects. There are 
few sets of data that were obtained with relatively complex 
shaped specimens such as a T, I, or H shape. In order to gain 
a better understanding of the availability of data on material 
type, defect t 5 q)e, and specimen complexity, a table (Table 3-2) 
is constructed to categorize the data sets according to test 
specimen complexity. Within each data set, a brief description 
of the material type, NDE methods, and defect type is presented. 

The materials and shapes for which valid data were obtained 
and statistical analysis results are computed are tabulated 
later in Section V (RESULTS). 


reproducibility OF 
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Table 3-1 STATUS AND CATEGORY OF DATA 
CONSIDERED FOR NDE RELIABILITY ASSESSMENT 


Data that satisfy the 
criteria discussed in 
Subsection 3ol and were 
statistically analyzed 


Data that lack owner per- 


mission use 


Data that were not statistically 
analyzed due to the lack of 
sufficient inspection procedure 
or defect dimension documentation 
or both 


References : 


References : 


References : 


5 Pressure Vessel 
Research Committee 
approval needed 
before data can be 
used 


6 Same as 5 above 









Table 3-2 Data Grouping According to Specimen 
Thickness and Complexity 


Flat Plates and Simple Shape 

Cylindrical, I, H, T and other 
Moderately Complex Shapes 

Actual Aircraft Structures 

References : 

1 2219-T87 A1 up to 1 cm 
thick 

o Cracks in plates and 
welded plates 
o Ultrasonics, penetrant, 
eddy current, and X-ray 
o Laboratory environment 

2 2219-T87 A1 up to 1 cm 
thick 

o Fatigue cracks in flat 
plates 

0 Ultrasonic, penetrant, 
eddy current, and X-ray 
o Laboratory environment 
(mostly) 

4 2219-T87 Al up to 1 cm 

thick 

o Fatigue cracks in flat 
plates 

o Ultrasonic, penetrant, 
eddy current, and X-ray 
o Laboratory environment 
(mo s t ly ) 

References : 

3 7075-T6511 Al 

0 Fatigue cracks in 
cylindrical tubes 
o Ultrasonic, penetrant, 
and X-ray 

4300 V Steel 
o Fatigue cracks in 
cylindrical tubes 
o Ultrasonics, penetrant. 
X-ray, and magnetic 
particle 

0 Laboratory environment 

10 2024 Al 

o Forged defects 
o Ultrasonic, penetrant, 
eddy current. X-ray 
0 Production environment 

4340 M Steel 
0 Forged defects 
0 Ultrasonics, penetrant 
eddy current. X-ray, and 
magnetic particles 
0 Production environment 
Some grinding cracks and 
hydrogen embrittlement 
cracks 

References : 

11 7178-T651 Al 

o Naturally occurring 
fatigue cracks in bolt 
holes 

o Eddy current 
0 Laboratory and depot 
level 

13 6A1-4V-Ti and 7075-T6A1 
0 Fatigue cracks off C-5A 

Pylon (actual and 
simulated) 

o Ultrasonics and X-ray 

14 7075-T6 Al 

o Fatigue cracks off C-130 
wing boxes (actual and 
simulated) 

o Ultrasonics and eddy 
current 

20 KC-135 lower wing skin 

panel and laboratory 
specimens with fatigue 
cracks under installed 
fastener 
0 Ultrasonic 
0 Laboratory and field 
environment 



Table 3-2 (Continued) 


Flat Plates and Simple Shape 

Cylindrical, I, H, T and other 
Moderately Complex Shapes 

Actual Aircraft Structure 

5 Steel forging up to 25 cm 
thick 

o Induced and naturally 
occurring defects 
o Ultrasonics 
o Laboratory environment 

6 Steel welded-plates up to 
28 cm thick 

o Induced weld defects 
o Ultrasonics and X-ray 
o Laboratory environment 

7 2219-T87 welded plates of 
0,62 and 1.25 cm thick 

o All t}7pes of weld defects 
o Ultrasonic and X-ray 

8 2219-T87 A1 up to 1 cm thick 
0 Fatigue cracks in flat 

plates 

o Ultrasonic, penetrant, eddy 
current, and X-ray 
o Production environment 
(mostly) 

9 2219-T87 and 2014-T6A1 up to 
2*5 cm thick 

6A1-4V-T1 and 5A1-2.5 Sn Ti 
up to 1% cm thick 
0 Fatigue cracks in flat platei 
weld defects in plates 

15 6A1-4V-Ti 

o Induced forging defects 
0 Ultrasonics, penetrant 
X-ray 

o Most production environ- 
ment 

18 D6ac Steel 

0 Induced forging defects 
o Ultrasonics, magnetic 
particle and rubber 
0 Production environment 

3 
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Table 3-2 (Continued 


Flat Plates and Simple Shape 

Cylindrical, I, H, T and other 
Moderately Complex Shapes 

Actual Aircraft Structure 

o Ultrasonic, penetrant, 
X-ray, and eddy current 
o Laboratory environment 

12 2219-T87 Welded plates of 

1.25 and 2,5 cm thick 
o All t37pes of weld defects 
o Ultrasonic and X-ray 

16 6A1-4V-Ti up to 13 cm thick 

o Ultrasonic 

o Flat bottom holes and in- 
duced defects 

6A1-4V-Ti Diffusion Bonded 
thin plates 
o Induced defects 
o Penetrant 

Al Samples 

o Fatigue cracks in flat 
plates 
o Penetrant 

6A1-4V-T1 

0 Fatigue cracks in flat 
plates 
o Penetrant 

Steel 

0 Induced weld defects 
o Ultrasonics 







Table 3-2 (Continued) 


Flat Plates and Simple Shape 

Cylindrical, I, H, T and other 
Moderately Complex Shapes 

Actual Aircraft Structure 

Al, Ti, and Steel Plates 
(multiple) 

o Cracks in fastener holes 
o Eddy current 

All in production environ- 
ment 

17 Similar to those described 

in Reference 16 

19 o D6ac Steel Plate 

Delta Scan Ultrasonics 

' 

, 

19 0 D6ac, 4340, and other 
Steel Alloys 
Actual Aircraft Struc- 
ture 

Magnetic Particle 





IV STATISTICAL DETERMINATION OF NDE RELIABILITY 


This section describes the binomial statistical method, 
cumulative schemes, statistical pooling procedure, and digital 
computer code for computing NDE reliability. 


4.1 Introduction 

There are four possible outcomes from any nondestructive 
inspection of an item: (1) detection of a defect that is 

present, (2) non-detection of a defect that is present, 

(3) detection of a defect that is not present (false indication) , 
and (4) non-detection of a defect that is not present. Because 
of these four possible outcomes, any single inspection may be 
called a quadrinomial event. Although it is recognized that 
false indications of defects and true indications of non- 
defective items (cases 3 and 4) are of practical significance 
to both the manufacturer and the customer, it is beyond the 
scope of this investigation to develop a straightforward 
statistical method for handling the quadrinomial event. 

Preliminary indications show that most NDE reliability 
investigations have neglected to report information concerning 
either false indications of defects, or true indications that 
specimens contained no intentionally induced flaws. However, 
the data input format discussed in the previous section provides 
for storage of information concerning false indications for 
future use when more of these data become available. 

Cases (1) and (2) involve either a detection or non- 
detection of a defect that is known to exist. This event can 
best be described statistically by applying the binomial distri- 
bution. The Normal, Chi-square, and Poisson distributions are 
sometimes used as approximations to the binomial. Their 
applicability to the problem of NDE reliability is to be 
considered in the later sections of this report. 


4.2 Application of Binomial Distribution 

An event that has only two possible outcomes is referred 
to as a binomial event. Suppose, for example, an experiment 
in NDE is performed where N specimens, all containing identical 
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flaws, are routed through an ultrasonic inspection system. 
Suppose further, that the system capability does not change 
throughout the entire inspection process, i.e., each specimen 
is evaluated independently of the others. Let p equal the 
true, (but as yet unknown) probability of detecting each flaw 
and q=l-p be the probability of missing each flaw. Assuming 
p remains the same for all specimens, the random variable X 
can be defined as being the number of flaws that are detected 

in any given experiment, X, then, is referred to as a binomial 
random variable with parameters N and p. Its possible values 
are 0, 1, 2, ..., N, Equivalently, it can be said that X has 
a binomial distribution. The probability of obtaining any one 
of the N+1 possible values of X from such an experiment is 
described by the following equation: 


P(X==n) =1 


n 


N-n 


where 


n\ ^ Nl 
nj nl(N-n)! 


n=0 ,1, . • . ,N 


( 1 ) 


The sum of all the possible values for equation (1) is equal 
to unity and can be written as follows: 


(p+q)*^ 


N 

E 

n=o 



n N-n 

p q 


1 


( 2 ) 


The probability of detecting n or more flaws can be found by 
summing equation (1) over all the values of X for which 
X > n. Thus , 


N 

P(X^n) = 

i=n 



N-i 


q 


(3) 


4,2.1 Confidence Interval Estimates of the True Probability 
of Detection 

The objective is to estimate the true proportion of 
defects of a particular type and size that can be detected by 
a given NDE method. The best single estimate, p, of the true 
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detectable proportion is the number of flaws detected divided 
by the total number of flaws present: 


p - 


n 

N 


(4) 


If the binomial experiment (N, p) is repeated an 
infinite number of times and if is computed each time, 
then the average of all the p^s will be equal to po So p 
is an unbiased estimator of the true probability of crack 
detection* 


Since the probability is small that p will exactly equal 
p on any specific replication of the experiment, an interval 
estimator that will contain p most of the time is considered 
useful. A lower one-sided confidence interval can be used to 
estimate a lower bound on the true probability of crack de- 
tection. The lower bound, p^, for n detections of N cracks 
is computed as follows : 


Solve Z^(i) (5) 

i * n 


for p^, where 

« = 1 - G (6) 

The following interpretation can be given for a 
lOOG percent lower binomial confidence interval. If the 
binomial experiment (N, nj^ , p) is repeated many times 
(theoretically infinite), and if p^^^ is computed each time, 
then lOOG percent of these lower confidence intervals will 
be equal to or lower than p. Thus, there is lOOG percent 
"confidence" that the lower bound, p^^, computed for any 
specific binomial experiment will be less than or equal to 
the true probability of crack detection. The choice of G 
is arbitrary and depends on how sure one needs to be that the 
true probability of detection is in the interval from p^ to 1, 
(the larger the value- of G, the smaller the calculated lower 
bound pj^ will be) , 

* nj^ is the number of successes in the Kth replication of a 
binomial experiment consisting of N measurements. 
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4, 2.2 Sample Size Determination 


The objective is to determine the sample size required 
to estimate the lower confidence limit and confidence level. 

This can be accomplished by utilizing equation (^) . By 
specifying the confidence level, G, and the lower confidence 
limit p,, a set of values (which must be integers) can be 
computea for N and n. Each combination of N and n in this 
set indicates the number of inspections and the number of 
detections required to achieve the specified probability of 
detection (POD) at the stated confidence level. For example, if 
G and p^ are chosen to be 0.95 and 0.9 respectively, equation 
( 5) becomes 

N / \ 

0.95 = 1 - ^ Pj (0.9)’'(0.1)’^"’'. O) 


One of the combinations of N and n is 29 and 29 respectively. 
This represents the smallest sample size that can be utilized 
to meet the minimum specified values for G and p^. The next 
smallest sample size is N=46. In this case n must equal at 
least 45 to achieve 907o probability of detection at 95% 
confidence level. The higher the reliability requirements, 
of course, the larger the sample size required. 

Equation (5) can also be used to calculate the number 
of added NDE tests required to upgrade an existing batch of 
data in the hope of achieving higher reliability estimates. 
Equation (5) takes on the form 



(i-pj) 


N+^-i 


( 8 ) 


where 6 is the required number of additional tests and 
€ is the maximum number of additional misses (nondetections) „ 
For example, if an experiment consisting of 29 inspections 
and 28 detections was performed, the reliability (equation 5) 
is 90% probability of detection at 80% confidence level o If 
a 95% confidence level is desired, the additional data require- 
ments are indicated by equation (8), Thus, ^ = 17 with c “ 0 
represents the minimum added sample required to upgrade the 
existing data. 
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4.3 Comparison of Alternative Statistical Procedures 

Table 4-1 lists the probability of detection at the 95% 
confidence level for four commonly used probability analysis 
methods, (Binomial, Normal, Poisson, and Chi-Square). The 
comparison is on the basis of 30 trials with 10, 15, 20, 25, 

29 and 30 detections. The Binomial gives the exact results. 

The Normal approximation gives confidence values greater than 
the Binomial for large successes (30/30), and very nearly 
equal to the Binomial for intermediate successes (15 or 20/30). 

The Poisson approximation gives values less than the Binomial 
method. It is a good approximation only for cases with large 
number of trials with small number of successes. For 30 trials, 
the Chi-Square method gives values less than the Binomial for 

10 to 30 successes. Like the Poisson, the Chi-Square values 
approach those of the Binomial for less than 10 successes in 

30 trials. 

However, a closer approximation to the Binomial for 
both the Poisson and Chi-Square can be achieved by using a 
conditional approach. By first calculating the upper one-sided 
confidence limit for the probability of missing a flaw (9^), the 
lower one-sided confidence limit for P^ = 1 - can then be 
approximated when 1 - n<n. By using this conditional approach, a new 
set of values is calculated and included in Table 4-1 under the 
conditional approach column. These new values give a much better 
approximation to the Binomial when the number of successes is high. 

Since the Poisson and Chi-Square approximations yield almost 
the same values, only one set of values was calculated under 
the new conditional approach. 

For larger or smaller number of trials, the above com- 
parisons is not necessarily true but the comparison generally 
shows the importance of analyzing binomial measurements with 
binomial statistics. 
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Table 4-1 Comparison of Probability of Detection 
Values Obtained by Approximation to the 
Binomial Distribution 


NUMBER OF 
SUCCESSFUL 
DETECTIONS 
IN 30 TRIALS 

POINT 

ESTIMATE OF 
PROBABILITY 
OF DETECTION (p) 

LOWER ONE 

SIDED CONFIDENCE LIMITS AT 95% CL 

CONDITIONAL 
APPROACH 
POISSON AND 
CHI-SQUARE 

BINOMIAL 

NORMAL 

POISSON* 

WmtSSkiB^SSS^SSLM 



(Exact) 





10 

0.333 

0.193 

0.192 

0.181 

0.181, 

0.181 

15 

0.500 

0.339 

0.350 

0.308 

0.308 

0.308 

20 

0.667 

0.501 

0.525 

0.441 

0.442 

0.435 

25 

0.833 

0.681 

0.721 

0.578 

0.579 

0.650 

29 

0.967 

0.851 

0.913 

0.691 

0.691 

0.842 

30 

1.000 

0.905 

1.000 

0.715 

0.720 

0.900 


*No conditional information was used in obtaining these numbers, see ’’Reliability 
Management Methods and Mathematics,” Lloyd and Litow, Prentice Hall, 1962, pp. 218-219 






4.4 Data Cumulation Methods 


The calculated value for the lower confidence limit 
(probability of detection, p^, at some selected confidence 
level, CL) is influenced by the total number of measurements 
(sample size). In order achieve a high POD at a high CL, 
such as 90% at 95% confidence level, a minimum of 29 measure- 
ments have to be made without a miss for a given flaw size. 
Because of the high costs involved, it is generally not 
economical to make 29 or more measurements for each flaw 
size for the entire range of flaw sizes of interest. At the 
same time, in the inspection of actual structural components, 
it is unlikely to have 29 or more measurements at any specific 
flaw size. As a result, size interval grouping has been used 
in order to obtain a sufficient number of measurements to 
compute a high p^^ at a high CL and to smooth over the flaw 
sizes that have no measurements. A cumulation plan permits 
the accumulation of data over a range of flaw sizes for 
computing a p^ which is representative of that range. 

Several cumulation procedures were considered. These 
procedures include (1) the range interval "RI", (2) the 
overlapping 60 points ”0SP” and (3) the procedure developed 
under this contract which will be called the optimized 
probability method "0PM.” Other procedures evaluated are 
reported in Reference 1. For the same set of data, the computed 
P;!^ can be considerably different depending on which of these 
cumulative procedures is used. Generally, NDE reliability is 
demonstrated by inspecting specimens containing flaws distributed 
uniformly over a wide flaw size range. The smallest flaws should 
be virtually nondetectable and the largest flaws should be 100% 
detectable. First, the raw data set is arranged in order of 
increasing flaw size with the appropriate outcome indicated for 
each measurement. The various cumulative procedures are applied 
as follows: 

(a) Range interval method . The data are separated into groups 
of equal flaw size increments. The probability of detection at 
the one sided lower confidence limit is computed for each group 
separately and plotted as a histogram bar. A conservative p^^ 
curve can be obtained by connecting the upper right hand corner 
of the bars. This procedure is most appropriate for computing 
probabilities of detection and confidence limits when large 
numbers of data are available so that all histogram bars repre- 
sent large data samples. It is important to note that sample 
size (N) may vary widely betweeti intervals. 
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(b) Overlapping sixty point method (N ~ 60) . One begins by 
combining detection results for the largest sixty crack sizes. 
The POD is calculated for this interval and plotted at the 
largest flaw size within the size range spanned. The next 
data increment is obtained by starting at the median flaw 
size of the first interval and combining the data for the 
next smaller 60 cracks. The POD of the second set is plotted 
at its largest flaw size and the process is repeated until all 
data have been combined. Each interval overlaps its adjacent 
interval by 30 data points. Note that the sample size is the 
same for each interval, but the breadth of the interval can 
vary widely. 

(c) Optimized Probability Method . The ordered NDE data are 
grouped into J (a computer input number) intervals of 
successively increasing size range. The POD of the largest 
size range is computed at some desired confidence level. The 
next smaller size range data are combined with the first and 
the POD of the second grouping is computed. This process is 
continued until J probabilities of detection are computed, 

and the largest value of POD obtained is plotted at the largest 
flaw size contained in the corresponding composite grouping. 

The largest flaw size interval is removed from consideration 
and this procedure is repeated starting from the next to 
largest flaw size grouping. The pattern is repeated until J 
probability of detections can be plotted. Note that if J is 
sufficiently large, the POD curve produced by this method will 
be the upper envelope of either the RI or the OSP method. 

The advantage to this method is that the sample size (N) is 
maximized, and results in the maximum possible value of p^^ for 
the available data, A basic assumption is that the larger the 
flaw, the more detectable it is. 



V. RESULTS 


Of the twenty sets of data collected, only seven sets 
were statistically analyzed. These seven sets appeared to 
meet the criteria stated in Section III of this report. Each 
of these seven sets, in turn, was subdivided into subsets and 
analyzed according to the NDE method and material t5rpes. 
Appendix D contains a computer listing of NDE data and de- 
tection reliability results that were analyzed during this 
program. Table 5-1 summarizes the results of the statistical 
analysis. There is a total of one hundred and twelve subsets 
and the subset number is given in the first column of Table 5-1. 
The second column gives data source. The third and fourth 
columns identify the material and defect type respectively. 

The fifth and sixth columns identify the specimen geometry 
and NDE method respectively. The seventh column lists some of 
the pertinent parameters, and the eighth column gives the crack 
length at which 90% probability of detection at 95% confidence 
level POD90(CL95) was first achieved. The shortest crack 
length that reached POD90(CL95) by either the 0PM or OSP scheme 
was used and is herein referred to as the threshold level. In 
many instances, the POD(CL95) became smaller than 90% at 
crack lengths above the threshold level. This is particularly 
true for the OSP scheme (see Appendix D) . For more details 
on the NDE parameters and inspection procedures that were used 
to acquire each set or subset of data, one has to refer to the 
original data reference. 

The first set of data analyzed is from Martin Marietta 
(Contract NAS 9 12276), Four subsets, one by ultrasonic 
surface wave, one by penetrant, one by eddy current, and one 
by the X-ray method, were available before the specimens were 
chemically etched and another four subsets were available 
after chemically etching the test specimens. 

The second and third sets of data analyzed are from 
Rockwell International-Space Division (Contract NAS 9-14000) 
and General Dynamics, Convair Aerospace Division (Contract 
NAS 9-12326). This set of data includes data from Contract 
NAS 9-12276 with the specimens in the "after-etched" condition. 
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TABLE 5-1 SUMMARY OF NDE DATA STATISTICALLY ANALYZED 

CAUTION: The crack lengths in the POD90(CL95) column 

are not intended to be used for design purposes 
unless the user demonstrates a similar capability 


DATA 

SUB- SET i DATA SOURCE 


MATERIAL TYPE 


DEFECT 

TYPE 


SPECIMEN 

GEOMETRY 


NDE METHOD 


PERTINENT PARAMETERS 


CRACK 

LENGTH 


10 

11 

12 

13 

14 

15 

16 
17 
10 

19 

20 
21 

22 

23 

24 

25 


Martin Marietta! 2219-T87 A1 
NAS 9 12276 


Rockwell Inter. 
Space Div, (NAS^ 
14000); Martin 
Marietta, and 
GD Convair 


Fatigue 

Cracks 


Flat Plates 


2219-T87 


Fatigue 

Cracks 


Flat Plates 


>Op90(CL95|) 


Ultrasonic- 
Surface Wave 

Liquid Penetrant| 
Eddy Current 
X-ray 

Ultrasonic - 
Surface Wave 

Liquid Penetrantj 
Eddy Current 
X-ray 


jBefore Etch, and with 
3 Ops; 10 MHz 


Same as above, Uresco 
P151,K410,D499C 

*bove;NDT-3; 

Same as above 
^fter Etch, and with 
3 Ops. 

Same as above 
Same as above 
Same as above 


Ultrasonic- 
Shear Wave 
(Surface Wave) 
f = 2.25 MHz 
for RI-SD 


f = 10 MHz 
for GD Convair 

Liquid Penetrantj 
P-133, D495A 
for RI - SD 


|After Etch, and by 
Operator 0 

Operator P 
Operator Q 
Operator R 
Operator S 

After Etch, and by 
Operator H 

Operator I 


Eddy Current 
Defectometer 
{Model 2.154 
f = 2 MHz 
for RI - SD 


Operator J 
Operator K 
Operator L 
Operator M 
Operator N 
After Etch, and by 
Operator T 

Operator U 
Operator V 
Operator W 
Operator X 


.345 

, 665 
.274 

.211 

.274 

.665 

.737 

.221 

-.699 

.699 

.358 

.282 

.737 

.737 

.333 

.737 

.340 

1.36 

.665 

.201 

.333 

.320 


*Data Set Numbers are Included on the Corresponding Computer Output in Appendix D. 
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TABLE 5-1 SUMMARY OF NDE DATA STATISTICALLY ANALYZED (Continued) 


DATA 
SUB- SET 


26 

27 

28 

29 

30 

31 

32 

33 
34, 

35' 

36 

37 

38 

39 

40 
41' 

42 

43 

44 

45 

46 

47 

48 


DATA SOURCE 


miERIALJEYPE. 


RI-SD, Martin 
Marietta, &GDC 


RI-B-1 Division 
(TFD-72-925) 

(TFD-72-1005) 

(TFD-72-1515) 

(TFD-72-793) 

(TFD-72-767) 

(TFD-73-532) 

(TFD-73-532) 

(TFD-73-496) 

(TFD-73-371) 

(TFD-73-372) 

(TFD-73-140) 

(TFD-72-768) 

I RI-SD, MM, GDC, 
[and RI-Bl 


DEFECT 

TYPE 


2219-T87 Al 


patigue 

Cracks 


T1-6A1-4V 


[Fatigue 

Cracks 


racks 


SPECIMEN 

GECaiETRY 


Flat Plate 


Flat Plate 


7075-T6511 Al 

PH13-8 Mo. St, 

T1-6A1-4V 

4330V St. 

PH17-4 St. 

PH17-4 St. Cracks ' 
2219 -T87 and Fatigue 
7Q75;-T6511 Al [ Cracks 


Flat Plates 


Fatigue 

Cracks 

Fatigue 
Cracks , 
Corroded 


Flat Plates 

f Welded Flat 
Plates 


Flat Plates 
Flat plates 


NDE METHOD 

PERTINENT PARAMETERS 

:rack 

LENGTH 



D90(CL95) 

X-ray 

After Etch and by 

cm 

Operator A 

— 


Operator B 



Operator C 



Operator D 

- 


Operator E 

.737 


Operator F 

- 


Operator G 

“ 

Ultrasonics 

After Etch and Merged 

.201 

Liquid Penetran 

Results of 5 Operators 
; After Etch and Merged 

.237 

Results of 7 Operators 


Eddy Current 

After Etch and Merged 

.282 

Liquid Pene. 

Results of 5 Operators 
Used P5F-1 Penetrant 

.133 


Used P5F-2 

.170 


Used P5F-2 and DlOO 

.178 


Developer 



Used P5F-2.5 

.127 


Used P5F-2.5 

.173 


Used P5F-2.5, NQ-1 

.203 

Ultrasonic, 

Used P5F-2.5, DlOO 
Used P5F-2 and NQ-1 
Developer 

.173 

Shear Wave 

Simulate Welded Flaws 

.211 


Simulate Flaws in 

.218 


Wrought St. 

- 


Liquid Penetrant Merged Results from the 
1 Four Data Source on Al 


.241 



TABLE 5-1 SUMMARY OF NDE DATA STATISTICALLY AMLYZED (Continued) 


DATA 

SUB-SET 

DATA SOURCE 

MATERIAL TYPE 

49 

Lockheed GA 

4330V St. 

50 

(TR-68-32) 


51 


7075-T6511 A1 

52 


4330V St. 

53 


4330V St. 

54 


7075-T6511 A1 

55 ! 


7075-T6511 A1 

56 ' 


4330V St. 

57 

Boeing, W.Kan. 

7178-T651 A1 

58 



59 



60 ' 

Boeing Comm. 

2024-T6 A1 

61 

Airplane Co. 

4340 M St 

62 

(TR-74-241) 

II 

63 


II 

64 


II 

65 


2074-T6 A1 


DEFECT 

TYPE 


SPECIMEN 

GEOMETRY 


Fatigue Cylindrical 
Cracks 

Shell 


7.62 cm in dia, 
0.64 cm thick 


Cracks 


Forge . Tandem T 
Closed 


Solid Cyl, , 
Threaded 
Hollow Cyl,, 

Filleted 
Hollow Cyl,, 

Solid Cyl. 
Tandem T 


NDE METHOD 
Liquid Penetrant 

Magniflux ZL-2, 
ZE-3, and ZP-4 

Mag, Particle 

Ultrasonic 

Shear Wave 5 MHz 

Ultrasonic 

Shear Wave 

X-ray 

X-ray 


PERTINENT PARAMETERS 
Laboratory Condition 

Production Condition 
Laboratory Condition 


E-4B; 

P-9B 

lus Others 



Hand Held E.C, Probe a1 
Tear Down Insp. at 
Depot Level 
Results of Team 2 

(At 5 Tpical of 3 more 
teams) 

Results of Team 4 (A- 
t5T>ical) 

Merged results of 5 
teams 

Production Insp. 


Laboratory Insp, 



TABLE 5-1 SUMM/^K? OF NDE DATA STATISTICALLY ANALYZED (Continued) 


DATA 



DEFECT 

SPECIMEN 



CRACK 

SUB- SET 

DATA SOURCE 

MATERIAL TYPE 

TYPE 

GEOMETRY 

NDE METHOD 

PERTINENT PARAMETERS 

LENGTH 







PO 

D90(CL95) 

66 


4340 M St 

Forged 

Solid Cyl, , 

ZL-2A and 30A; 

Laboratory Insp, 

cm 

.584 




Closed 

Threaded 



67 


.. 

;DM,,Sloti 

Hollow Cyl., 
Filleted 

ZE-4B; 

II II 

.787 

68 


11 


Hollow Cyl., 

ZP-9B; 


- 

69 


n 


Solid Cyl. ,Fil, 

Plus Others 


.229 

70 


It 

11 

II 'll 



• .406 

71 , 


2024-T6 Al 

II 

Tandem T 

Ultrasonics 

Production Insp, 

.533 

72 ' 


4340 M St. 

M 

Soli*d Cyl. Threat 

ed 5 and 10 MEIz 



73 


II 

It 

Hollow Cyl. 
Filleted 

Shear and Surfat 

e 

.330 

74 


II 

II 

Hollow Cyl. 

Wave 


* 

75. 


II 

II 

Solid Cyl. , 
Filleted 



.178 

76 


II 

II 

II II 



.356 

77 


II 


Solid Cyl. 

Ultrasonics 

Laboratory Insp. 

.356 

78 


II 


" " Fillett 

d 5 and 10 MHz 


' .229 

79 


II 

II 

Hollow Cyl, 

Shear and Surfat 

e 

.254 

80 


II 

II 

" " Fillett 

d Wave 


.330 

81 

■ 

2024-T6 Al 


Tandem T 



.432 

82 , 


4340 M St. 

It 

Solid Cyl. 

X-ray 

Production Insp, 

- 

83 . 



II 

” ", Fillet 

ed 


- 

84 



II 

Hollow " 




85 



II 

II II II 



- 

86 



II 

Solid ", Threat 

ed 



87 


2024-T6 Al 

II 

Tandem T 



- 

00 

CO 


4340 M St 

II 

Solid Cyl. 

X-ray 

Laboratory Insp. 


89 , 

/ 

4340 M St 


Hollow ", Fillet 

ed 


- , 

90 


II 


Solid ", Fillet 

ed 



91( w 


II 


Hollow ", 


^ 1 

- 
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TABI£ 5-1 SUMMARY W NDE DATA STATISTICALLY ANALYZED (Continued) 



DEFECT SPECIMEN 




andem T 


NDE METHOD I PERTINENT PARAMETERS 




Forge Solid Cyl. iag. Particle Production Insp, 

Hosed ” " j Filleted 

!DM 

" " " , Filleted 

" Solid ” , Threaded 


90JGL95) 


Solid Cyl. Mag, Particle Laboratory Insp. 

Hollow *' , Filleted 
Solid ", Threaded 
i " ", Filleted 

" IhoIIow " 


Solid Cyl. 


ddy Current Production Insp, 


" " , Filleted ED400 and 52 

» 11 ^1 at f*»100 KHz 

Hollow Cyl, 

" " , Filleted 

Tandem T 


Tandem T Eddy Current 

Solid Cyl. ED400 and 520 

Hollow Cyl., Fil. at f«100 KHz 
Solid ", Fillet 
Hollow Cyl, 


iboratory Insp. 








There are five subsets of data obtained with the ultrasonic 
method, each subset for a different inspector, three inspectors 
for Contract NAS 9-12276, one for NAS 9-14000, and one for 
NAS 9-12326. There are seven subsets of data obtained with 
the liquid penetrant method, each subset by a different 
inspector, three inspectors for NAS 9-12276, three for NAS 9- 
14000, and one for NAS 9-12326, There are five subsets of 
data obtained with the eddy current method, each subset by a 
different inspector, three inspectors for NAS 9-12276, one for 
NAS 9-14000, and one for NAS 9-12326. There are seven subsets 
of data obtained with the X-ray method, each subset by a 
different inspector: three inspectors for NAS 9-12276, three 
for NAS 9-14000, and one for NAS 9-12326, Subsets 33, 34 and 
35 were obtained by merging the data of five ultrasonic 
inspectors, seven penetrant inspectors, and five eddy current 
inspectors. The X-ray data were not merged because the results 
are not worthy of further consideration. 

The fourth set of data analyzed is from Rockwell 
International B-1 Division, B-1 NDI Demonstration Program, 

There were twelve subsets of data in this set. The fifth 
set of data analyzed is from Lockheed, Georgia, AFML Report 
No, TR-68-32. There are eight subsets in this data set. The 
sixth set of data analyzed is from Boeing Company of Wichita, 
Kansas. This set of data was obtained from eddy current 
inspection of bolt holes, after pulling off the bolts, from 
actual aircraft parts. 

The seventh set of data analyzed is from the Boeing 
Commercial Airplane Company, AFML Report No. TR-74-241, There 
are fifty-three subsets in this set of data. 

Data subset number 48 was obtained by merging the data 
from Martin Marietta (NAS 9-12276), Rockwell Int. -Space 
Division (NAS 9-14000), General Dynamics* Convair Division 
(NAS 9 12326), and Rockwell Int, -B-1 Division for aluminum 
for the liquid penetrant method. 
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All the data described in this report were taken from 
a total of nine alloys of aluminum, titanium, and steel. 
These alloys are described in Table 5-2, The predominant 
amount of data were taken with the four aluminum alloys. 


Table 5-2 Alloys with Valid Data 


Aluminum 

Steel 

Titanium 

2219-T87 

PH13-8MO 

6A1-4V 

7075-T6511 

4330V 


2024-T6 

PH17-4 


7178-T651 

4340M 
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VI o DISCUSSION OF RESULTS 


The tabulated and graphical computer output format 
(Appendix D) , is convenient for assessing the state-of-the- 
art in NDE reliability. It contains : 

(1) the binomial experiment results (N,n) in each of 32 

crack size intervals (tabulated in units of Mils and 

plotted in both Mils and cm.); 

(2) the 50 percent lower confidence limit for each interval POD(CL50 

(3) the 95 percent lower confidence limit POD(CL95) ; and 

(4) the number of new measurements required in each interval 
to demonstrate a 90 percent probability of detection at 
a 95 percent confidence level ”POD90(CL95) ” . 

These data are useful for comparing the effects of material, 
inspector, and inspection parameters on NDE reliability and 
seeing where data deficiencies lie. 

As can be seen in Figure D-la the POD fluctuates widely 
throughout 32 ranges for this set of data because of the 
variation in the number of measurements, N, reported in each 
range. Twenty of the ranges contain less than 29 measure- 
ments while six ranges contained no measurements at all. The 
number of measurements per range can be increased by broadening 
the flaw size interval per range, but there is still no 
assurance that all of the broader ranges will contain measure- 
ments. Fluctuation in the probability of detection due to 
the variation in the number of measurements in a range is a 
shortcoming of the range interval method. 

Figure D-lb shows the tabulated and graphic results ob- 
tained by using the optimized probability method (0PM) for the 
set of data in Figure D-la. As can be seen, the number of 
measurements available for each interval is much larger than 
for the range scheme. The thirty-first interval lists 183 
detections out of 183 measurements resulting in a POD of 98% 
plotted at 1.18 cm. The POD computed with the 0PM increases 
monotonically with increasing crack length and does not 
fluctuate as in the range scheme. The POD at 95% CL reaches 
89% for the first time at .32 cm for the 0PM versus .358 cm 
for the range scheme. 
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Figure D-lc shows graphic and tabulated results using 
the overlapping 60 points scheme. In this scheme, the number 
of measurements for each POD calculation is constant (60), 
Fluctuation in the POD can be attributed primarily to human 
operator and inspection process variations. The POD at 95% 

CL reaches 89% for the first time at ,328 cm, which is inter- 
mediate between the 0PM and the RI results, 

6.1 Effects of Material, Source, and Inspection Parameters 

It is apparent from data subsets 1 through 8 in Table 
5-1 that the sensitivity is increased for ultrasonic, liquid 
penetrant, and X-ray techniques after the test specimens 
were chemically etched. This increase is reasonable since 
the crack openings are enlarged. The sensitivity is decreased, 
however, for eddy current method after chemically etching the 
specimens. This effect is difficult to explain. 

Data subsets 9 through 32 show that the difference in 
the POD90(CL95) obtained by different inspection operators 
within a company vary as much as those obtained by companies 
which use different inspection parameters and procedures. 

Several observations can be made with subsets 9-14: 

(1) Operators P and S in subsets 10 and 13 can be considered 
to be model operators. Not only did they achieve a smaller 
POD90(CL95) threshold level than other operators, they were 
able to maintain the POD(CL95) at a relatively constant 
(and high) level for crack lengths above the threshold level 

(Figures D-10 and D-13), (2) Subsets 10 and 13 show that the 

sensitivity of the ultrasonic method increases or remains 
constant for increasing crack length, particularly for craek 
lengths above the threshold level. (3) Fluctuations in the 
POD(CL95) for crack lengths above the threshold level are 
primarily caused by fluctuations in operator efficiency and 
less likely by the sensitivity of the NDE method. 

Subsets 14-20 (Figures D-14 to D-20) show more fluctuation 
in the : POD(CL95) due to variation in operator efficiency than 
to types of penetrant or procedures used by the three different 
companies that made the measurements. There is a large variation 
in the threshold level of the seven operators. Three operators 
demonstrated threshold levels around .33 cm, another three 
demonstrated the level at .737 cm, and the seventh one demonstrated 
it at 1.35 cm. One should keep in mind that most of these POD 
(CL95) curves are relatively flat and the POD(CL95) is greater 
than 80% from ,254 cm on to the longer crack length. 
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Like the ultrasonic and penetrant results, the eddy 
current results showed considerable differences in the 
threshold level for the five different operators. In fact 
Operator V did not demonstrate POD90(CL95). However, he 
did demonstrate POD88(CL95) at a crack length of .737 cm. 
Operator T demonstrated POD90(CL95) at a crack length of 
.665 cm. However, he reached POD88(CL95) at a crack length 
of .399 cm. 

X-ray is not a good inspection technique for reliably 
detecting fatigue cracks. Data sets, 26 to 32 show that 
only one operator can achieve POD90(CL95). This forecasts 
that X-ray techniques will not be viable procedures for 
detecting fatigue cracks. However, this does not necessarily 
mean that the technique should not be used to detect other 
defects such as porosity. 

Merging data provides a means for observing overall 
detection reliability trends. When the data for five ultra- 
sonic operators were merged (subset No. 33) and calculated 
with the OSP scheme the POD(CL95) reached 95% at a crack 
length of 0.66 cm (see Figure D-33c) . However, it fell below 
95% at higher crack length, and it reached a minimum of 79% 
at a crack length of 0.810 cm. When the results of seven 
penetrant operators were merged (subset No. 34) and calculated 
with the OSP scheme, the POD(CL95) reached 92% at a crack 
length of 0.26 cm (see Figure D-34c) , but it fell 
below 90%, between 0.26 cm and 0.63 cm. It peaked to 95% at 
0.65 cm, then fell below 90% and reached a minimum of 81% at 
a crack length of 1.12 cm. When the results of five eddy 
current operators were merged (subset No. 35) and calculated 
with the OSP scheme, the POD(CL95) reached 92% at a crack 
length of 0.32 cm (see Figure D-35c), But like the ultrasonic 
and penetrant results, the POD(CL95) for the eddy current 
fell below 90% at higher crack length and it reached a 
minimum of 81% at 0.88 cm. 

Data subsets 36 through 47 (Figures D-36 to D- 47) 
from the B-1 NDI demonstration program. These data show that 
the POD(CL95) either increases monotonically or remains 
constant with increasing crack length once the threshold level 
is reached. In several data sets no further measurements were 
made once the desired threshold level was demonstrated. It is 
interesting that the threshold level as well as a large portion 
of the POD(CL95) curve does not differ greatly for several types 
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of penetrant applied to materials such as Ti-6A1-4V, 7075-T6511 
Al, PH 13-8 Mo steel, 4330V steel, and PH 17-4 steel. 

Data subset 48 represents the merged results of four 
data sources (Rl-Space Division, Martin Marietta, General 
D 5 mamics Convair, and RI-B-1) on 2219 -T87 Al by the liquid 
penetrant method on flat plates. 

Data subsets 49 through 56 were obtained with fatigue 
cracks in 4330V steel and 7075-T6511 Al having a cylindrical 
shape (7.62 cm in diameter and .62 cm thick). Data were taken 
in both the laboratory and production environments. None of 
the curves for these 8 sets of data attained POD90(CL95) , 
however, the penetrant results for 7075-T6511 Al did demonstrate 
P0D87(CL95) at a crack length of 1.0 cm, POD87(CL95) at a crack 
length of 1.17 cm, and POD89(CL95) at 1.47 cm. The POD for 
ultrasonic shear wave reached a value of POD86(CL95) at a 
crack length of .80 cm and POD87(CL95) at a 1.27 cm. 

Data subsets 57, 58, and 59 were obtained with eddy current 
inspection of bolt holes during tear-down inspection of KC-135 
wings at the depot level. The same holes were inspected by five 
separate inspection teams. The inspection results from four of 
the five teams were about the same. Figure D-57 shows 
the results of team number two which is representative of the 
four teams. Figure D-58 shows that the detection relia- 
bility of team ntimber four is considerably different than the 
other four teams. Figure D-59 shows the mereed results 
of the five teams. None of the five teams achieved POD>90(GI.95) . 

Data subsets 60 through 112 (Figures D-60 to D-112) were 
obtained from the Practical Sensitivity Limits program which was 
conducted by Boeing Commercial Airplane Company and supported 
by the NDE Branch of Air Force Materials Laboratory. The 
inspection results were obtained in both the laboratory and 
production lines of several Boeing Divisions. Divisions used 
different NDI procedure or specification, as well as diffeheht 
NDI techniques. For example, ultrasonic shear and surface waves 
of 5 and 10 MHz were used, different liquid penetrant systems i^n 
either the Group V or VI category were used, etc. Because the 
results were obtained under different NDE procedures, it is 
difficult to make comparison between results from different 
data sources. Furthermore, the majority of the defects used in 
this program were forging cracks instead of fatigue cracks, 
nevertheless the length of the crack at POD90(CL95) found by 
each of the NDI techniques is comparable, in most cases, to 
those found at other companies using fatigue cracks. 



6.2 Statistical Analysis Procedures 

All NDE measurements are considered to be binomial and 
describable by binomial distribution functions and binomial 
statistics. Because of this consideration, lower one sided 
confidence limits and data deficiencies can be rigorously 
computed. 

The only factor which reduces mathematical rigor is the 
crack length parameter. It is necessary to group NDE data 
into a size interval that will contain a population of 29 
successes without a miss in order to show 95 percent con- 
fidence that the probability of detection exceeds 90 percent. 

If a miss is encountered, it is necessary to have a higher 
population (see Table 6-1) in order to demonstrate POD90(CL95). 


Table 6-1 

Interval Sample Size and 
Successes Required to Achieve POD90(CL95) 


No . of 
Misses 

Interval Population 
Required, N 

No , of 
Successes, n 

0 

29 

29 

1 

46 

45 

2 

61 

59 

3 

76 

73 

4 

89 

85 

5 

103 

98 

6 

116 

110 

7 

129 

122 

8 

142 

134 

9 

154 

145 

10 

167 

157 


Once an acceptable size interval has been chosen that 
will produce a reasonable population, there remains a problem 
of selecting the crack length within the range at which to 
plot the computed POD(CL95) . For conservatism, the POD curves 
in this report are plotted through the maximum crack length in 
the interval. The crack interval is also indicated by a 
horizontal line connecting maximum and minimum crack sizes. 
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Three procedures for determining the probability of de- 
tection for the lower one-sided confidence level are compared 
in this report. Described earlier in Section 4.3, they were 
the range interval (RI) method, the optimized probability 
method (0PM) and the overlapping sixty point method (OSP) . 

The optimized probability method is preferred over the RI or 
OSP but requires more computational time. The main claim to 
success for the OSP method is that it forces groupings to be 
large enough to provide the capability for achieving POD95 
(CL95). The 0PM should provide the upper envelope to both 
the RI and the OSP methods. 

6.3 Data Deficiencies 

The data described in this report represents more than 
30,000 measurements, yet there are many gaps in the probability 
of detection for different defect types, material types, and 
specimen geometry by the five NDE methods (ultrasonics, liquid 
penetrant, eddy current. X-ray, and magnetic particle). The 
most data are available for fatigue cracks in flat plates of 
2219-T87 aluminum which reasonably characterize the reliability 
of all five NDE methods. There are also several sets of data 
for fatigue cracks in aluminum cylinders, forging cracks in 
extruded aluminum (tandem T configuration) , and fatigue cracks 
in bolt holes of actual aluminimi aircraft parts. There is a 
notable data deficiency for steel. Most of the steel data 
are for fatigue and forged cracks in cylinders. There are, 
however, four sets of data for fatigue cracks in flat plates 
of steel. Only five sets of data are available for titanium 
and all of them were taken on flat plates. 

With the exception of the B-1 NDE demonstration data 
most of the data exhibit a gap over some range of the crack 
lengths. A perfect example of this is the data from Martin 
Marietta, Rockwell International- Space Division, and General 
D5mamics-Convair Division, All these three companies made 
measutements using the same set of specimens which contains 
two gaps. As can be seen from the crack size distribution 
curve in Figure 6-1, there are no cracks with length between 
0,47 to 0.59 cm and between, 1.03 to 1.17 cm. Thus, no cracks 
can be detected in these two gaps and the probability of 
detection, regardless of which cumulative scheme is being used, 
is affected. A set of specimens without gaps in the crack 
size distribution curve is needed to study the actual proba- 
bility of detection in future programs. 
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6.4 Application to Fracture Mechanics 

The threshold crack length (the shortest crack length 
that reached to POD90(CL95)) that was detected by the 
different NDE techniques is given in Table 5-1. However, 
as can be seen from the curves in Appendix D, the POD (CL95) 
in many instances falls below 907o for some crack length longer 
than the threshold level. Thus the potential user is cautioned 
against using these threshold crack lengths in the design 
process. In the first place, the POD can vary from company 
to company even when the same inspection procedures were used 
because of training procedures and using different inspectors. 
In the second place, some of these POD curves do not have a 
zero or positive slope for crack length above the threshold 
level. The decrease in the POD above the threshold level could 
be a real phenomenon and might not necessarily be attributed 
to human factors. There are scatter reports, in the case of 
liquid penetrant, that indicate penetrant washes out of wide 
cracks before the developer is applied. 

In the fracture mechanics design process, one must be 
assured with some probability at some confidence level that 
no cracks larger than the assumed size can be present in the 
structure. Thus, for fracture mechanics to be a viable design 
process, the probability of detection as a function of crack 
length must be monotonically increasing or at least levels 
off above some selected threshold crack length. 
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Figure 6-1 Differential and Integral Crack Distribution 
Function fot the Martin Marietta Demon- 
stration Program. 2219-T87. 



6.5 Optimum Demonstration Program 

In order to determine the reliability of an NDE technique 
without operator influence, the optimum demonstration program 
will have to employ computer automation in scanning specimens 
and interpreting NDE signals. It should incorporate ultrasonic, 
eddy current and penetrant inspection into each demonstration 
program. 

The data in this report can be used to estimate the 
sample size required for the optimum demonstration program. 

For example, if one can afford to test 100 specimens and 
requires a 50-50 chance of success in demonstrating POD90/CL95 
then one would have to select a data set representative of this 
expected capability and select a crack length for his demon- 
stration program for which the probability of detection is at 
least 957o. If he can afford only 45 specimens then he must 
choose a crack length for which the probability of detection 
is at least 98%. This can be seen in Figure 6-5 where number of 
misses corresponding to POD90(CL95) is plotted against the 
number of specimens tested. The shaded region is the region 
of success for which POD 90(CL95) has been met or exceeded. 

The broken lines show the number of failures expected for 
various values of POD (98, 95, 94, 93, 92, and 90%). 

Assume that data set # 1 (Figure D-1) is 
for a geometry and NDE method that is most representative 
of those required in a demonstration program. These data 

demonstrate a POD(CL95) at .345 cm. Figure D-la would lead 
one to believe that POD 90(CL95) might be demonstrated at 
about .27 cm for which 38 out of 39 cracks were detected. 

Figure D-la shows that one can be 50 percent confident that 
the probability of detection exceeds 95% for this case if 
his NDE techniques are as good as those used to produce data 
set # 1. Figure 6-2 shows that if 110 test cracks were 
fabricated and tested and that less than 5 cracks were missed, 
then the demonstration program would be successful. 

The previous example is indicative of the usefulness of 
these data as a means for minimizing the number of specimens 
required for achieving a successful demonstration program. 

The common practice of manufacturing a large number of crack 
specimens for which there is little chance to achieve 
POD 90(CL95) will be eliminated by this approach to designing 
an optimum demonstration program. 
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VII o CONCLUSIONS 


This program was sponsored by NASA as a service to the 
new fracture mechanics approach to structural design whereby 
system reliability may be related to the expectation that 
flaws larger than a specific size may exist in the structure. 

The program objectives were to (1) collect all available NDE 
reliability data, (2) examine the validity of the data, 

(3) select and computerize a statistical procedure for 
analyzing the data, and (4) generally assess the current state- 
of-the-art in NDE. We feel that the surface has been broken 
by this program but vigorous follow-on work would be very 
valuable to the field of structural design. 

Some of the specific conclusions that can be drawn from 
the contents of this report and the experience gained in 
performing this study are: 

(1) The human factors influence stands out as dominating in 
influencing NDE reliability. Although a company can demonstrate 
a 90 percent probability of detecting a crack at a lower one 
sided confidence limit at the 95 percent confidence level, there 
is no guarantee that this is indicative of a continuing capa- 
bility unless some form of automation has replaced hximan judgment. 
This then indicates a need for some type of periodic audit of 
capability. 

(2) Although more than 30,000 measurements have been filed in 

a computer library and analyzed to determine the NDE reliability 
of X-ray, ultrasonics, eddy current, and penetrants, there are 
still many gaps in the data: There are no eddy current data 

in the data bank for titanium nor are there much data for crack 
lengths near ,5 or near 1.2 cm. These data deficiencies cause 
large uncertainties in the POD plots for these crack lengths. 

(3) Binomial statistics are recommended for analyzing NDE 
reliability data. This report contains a comprehensive dis- 
cussion of the preferred analysis model, 

(4) The optimized probability method (0PM) of data cumulation 
is preferred over the range interval or the overlapping sixty 
point scheme for computing probability of detection. The 
optimum probability model which was developed during this 
program is discussed in this report. 
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(5) Data show that the X-ray technique is not viable for 
detecting tight fatigue cracks. 

(6) In order to obtain optimum results from an NDE demon- 
stration program, special care must be taken in the design 
of flaw size distribution. The cumulative distribution must 
always maintain a positive slope or there will be gaps without 
data which can have deleterious effects on the POD curves as a 
function of flaw sizes. 

(7) The data presented in this report are offered as a guide 
for manufacturers who intend to perform an NDE reliability 
demonstration program and can identify data sets that represent 
their expected NDE capabilities. However, due to the human 
factor influence on POD, the data cannot be used as design 
information. Each company must develop reliability numbers 
for their own use. 

(8) A continuing program to maintain an NDE reliability data 
file and to optimize the data processing procedures formulated 
during this program would be useful to the field of fracture 
mechanics. As the data base becomes larger it will begin to 
support parametric studies of the influence of NDE variables. 
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APPENDIX A 


A MODEL TO GRADE THE QUALITY OF THE DATA SETS 


The thoroughness of the characterization of the defect- 
specimen and the documentation of the inspection procedures 
affects the quality and the usefulness of the data sets, A 
designer will not have confidence in using the data unless 
the inspection procedures and defect dimensions are sufficiently 
documented so that it can be reproduced in future inspections. 

The model described in this section will only relate to the 
quality of each set of data. It will not address the question 
of applicability. That is, a set of data obtained on flat 

plates will not be graded on the basis of its applicability 
to the design of complex structures. 

The model is empirical and the weighting factors assigned 
to the various known pertinent parameters are rather arbi- 
trary, However, it does represent a first attempt to 
quantitatively evaluate the quality of a data set. Each of 
the pertinent parameters in this model is listed in the 
Input Data Format which will be discussed in the next sub- 
section, The grade for a given set of data can be tallied 
in the computer by checking the entries to the columns con- 
taining these pertinent parameters, A score of one hundred 
(100) corresponds to a perfect set of data. A perfect set 
of data is one where all the pertinent parameters are 
documented. 

The preliminary model to grade the data quality for the 
ultrasonic, eddy current, liquid penetrant, magnetic particle, 
and X-ray methods is given in Table A-rl. The model is divided 
^ major groups. Group A is the characterization of 
specimens and defects and it is common to all techniques. 

Group B is the documentation of the inspection and is different 
for different NDE techniques. The first eight parameters in 
this last group are common to all techniques. Each technique 
has about eleven parameters that are considered pertinent 
to adequately document the inspection. Parameter A1 is the 
description of the specimen geometry and defect location. 

This is considered a key parameter and a value of 7 points 
is arbitrarily assigned to it. If no description about the 
specimen geometry and defect location is given, that data 
point or set of data will receive no points. Those parameters 
that are marked by an asterisk are considered key parameters. 

If any of them is not recorded, the data point or set will be 
considered for possible exclusion from statistical analysis. 
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Table A-1 


THE GRADING FACTORS USED TO GRADE NDE DATA QUALITY 
A. Specimen - Defect Characterization Information 35 


1. 

Specimen geometry complexity and defect 
location 

* 

7 

2. 

Crack dimension verification 

* 

10 

3. 

Defect t57pe 

* 

3 

4, 

Specimen surface condition 

* 

3 

5, 

Material characterization (thermo- 
mechanical history) 


3 

6 . 

Material inside defect 

* 

3 

Inspection Documentation 


65 

1. 

False indication recording 


4 

2. 

Inspector qualification level 


3 

3. 

Knowledge of defect orientation, 
location, and presence by inspector 

•k 

9 

4. 

Use of proof load 

* 

3 

5. 

Use of control specimens without 
crack 


3 

6. 

Method of data recording 


3 

7. 

Method of scanning specimens 


3 

8. 

Insp. environment 

* 

3 

9. 

Number of insp. prior to this insp. 


3 

10. 

Parameters recorded by nondestructive 
testing standards 




a. Radiography 
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1) Radiographic source 

* 

3 


2) Ref. standard 


3 
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(Continued) 


3) 

Detector type 

* 

4 

4) 

Voltage 


4 

5) 

Current 

* 

4 

6) 

Exposure time 

* 

4 

7) 

Source/film distance 

* 

4 

8) 

Angle of entry 

* 

3 

9) 

Film development parameters 


3 

10) 

Radiograph density 

* 

3 

11) 

Radiographic equipment type 


3 
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1) 

Ultrasonic method 

* 

4 

2) 

Frequency 

* 

4 

3) 

Transducer t3q>e and size 

* 

4 

4) 

Reference standard type and 

size * 

4 

5) 

Angle of incidence (inside 
material) 

the * 

3 

6) 

Equipment type 


3 

7) 

Gate alarm level (7o of ref. 

signal) * 

4 

8) 

Gain setting (7, of screen saturation) * 

4 

9) 

T 3 ?pe of coupling 


3 

10) 

Index interval 

* 

3 

11) 

Contact or Immersion 


3 
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10. (Continued) 




c. Eddy Current 


38 

1) 

Method of Scan 

* 

3 

2) 

Coil size 

* 

4 

3) 

Coil arrangement and shape 

* 

3 

4) 

Frequency 


4 

5) 

Reference t 5 rpe and size 

* 

4 

6) 

Equipment type 


3 

7) 

Index interval 

* 

3 

8) 

% of meter response 
(Real Part) 


4 

9) 

7o of meter response 
(Imaginary Part) 

ic 

4 

10) 

Lift-off compensation 


3 

11) 

Signal processing 


3 

d„ Penetrant 


38 

1) 

Penetrant t5rpe 

* 

4 

2) 

Developer type 

* 

4 

3) 

Classification of penetrant 
no.) 

(group 

2 

4) 

Emulsifier type 

* 

4 

5 ) 

Pre-insp* surface cleaning and * 
penetrant removal 

3 

6) 

Method of penetrant application 

3 

7) 

Dwell time 

* 

4 

8) 

Development time 
A-4 

* 

4 



10, (Continued) 


9) Wash time 

10) Light type and intensity at 
specimen surface 

11) Reference standard type 
e. Magnetic Particle 

1) Type of current used * 

2) Current level (Amperes) * 

3) Method of magnetization 

4) Direction of magnetization * 

5) Magnetic flux density * 

6) Magnetic particle type and size * 

7) Magnetic particle density 

8) T5^e of liquid vehicle 

9) Method of particle application 

10) Equipment t 5 q)e 

11) Dwell time (seconds) * 


4 

3 

3 
38 

4 
4 
4 
4 
4 
3 
3 
3 
3 

3 

4 
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APPENDIX B 


DATA POOLING 


B,1 Data Pooling by NDE Method and Parameters 

Data that meet the preliminary criterion as described in 
Subsection 3*1 are input to the computer for statistical 
analysis o Then data from several sets are pooled and analyzed 
if they have a common set of parameters. Data from different 
NDE methods are not to be pooled. For a given NDE method such 
as ultrasonic shear wave at 5 MHz, reliability curves will be 
plotted for a material t 5 ^e, a defect type, an environment, a 
specimen geometry and defect location, and either before or after 
some enhancement such as a proof test. Composite reliability 
curves can be plotted by pooling data with different parameters, 
such as pooling 5 and 10 MHz shear wave data, laboratory and 
production data, flat plate and cylindrical shell data, etc. 

B.2 Statistical Pooling Criteria 

The NDE data that is compiled for this contract was 
collected from different sources using different calibration 
factors, different equipment, different personnel, different 
environments, etc. Each set of data therefore contains unique 
source characteristics that preclude indiscriminate pooling for 
reliability calculations. 


A statistical pooling criteria has been developed to 
safeguard against mistakes or inconsistencies in the data 
which would produce abnormal statistical results. The data 
pooling technique is based solely on the binomial distribution 
and is described below as a procedure which can be implemented 
on a computer. The procedure consists of the following four 
steps . 


(1) The best single estimate, p , for probability of 
detection ^ 


M 
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where M is the number of data sets to be pooled. 

(2) The best single estimate of the true probability 

k 

of each of the data subsets is computed. 

(3) Consider the binomial distribution function 

for each data set (N^^, n|^) having a true 
probability of detection given by The 

two-sided probability, 0 * 2 , that (N|^, n^) 
and all less likely outcomes are possible is 
computed from 



( 11 ) 


( 12 ) 


(4) All data sets havi^ng a value of cvo less than a 
reference value a (computer input value) are 
removed as candidates for pooling. 

The choice of ol is somewhat arbitrary and depends upon 
the acceptable risk. The data sets that will be rejected 
from pooling for a given value will be reviewed. If no 
abnormal ties are found within each set of data (l.e., no 
mistakes in data recording, or other possible means of 
causing the probability of detection to be normally high or low) 
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a new value of a' will be tried and one that will permit 
the data sets to be pooled with the data base will be 
selected. Thus, the value for Ct' may be governed by operator 
judgment of the validity of the data. 

Table B-1 is an example which contains six hypothetical 
binomial experiments (assuming all sets have the same measure- 
ment parameters). (For this examples* was chosen to be .05). 
The 0*2 values for sets C, E, and F are very low. The ct2 
values for sets C and E were calculated using Equation (11) 
and for set F was calculated using Equation (12) . For set C 
one is only 2.22% confident that one out of eight measurements 
is successful. For set E one is only 0.86% confident that one 
out of ten measurements is successful. For set F one is only 
0.11% confident that seven out of seven measurements are 
successful. The confidence is too low for measurements to be 
pooled with those of sets A, B, and D, 

Upon rejecting sets C, E, and F, new ct2 values are 
calculated for sets A, B, and D using the p^ (16/40), These 
three sets have comparable confidence limits and they will be 
pooled. 
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Table B-1 

SIX SETS OF DATA FROM DIFFERENT SOURCES 
(A-F) TESTED FOR POOLING 


Source 

N Number of 
Measurements 

n Number of 
Successes 

Oo (Alpha) 

A 

24 

9 

.4085 ( accepted) 

B 

8 

3 

.3612 (accepted) 

C 

8 

1 

.0222 (rejected) 

D 

8 

4 

.3572 (accepted) 

E 

10 

1 

.0086 (rejected) 

F .| 

7 

7 

1 

i 

.0011 (rejected) 

TOTAL 

65 I 

25 


A 

24 

9, 

.3641 (accepted) 

B 

8 

3 

.3361 (accepted) 

D 

8 

4 

.3834 (accepted) 

TOTAL 

40 

16 
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APPENDIX C 


NASA. FTN COMPUTER CODE 

NASA, FTN is v\;ritten in Fortran and organized with a 
main routine performing all executive functions. Main does 
no' data manipulation, it simply calls other routines which 
manipulate the data. 

The flow diagram Figure C-1 illustrates the run sequence 
of the program. Two inputs required for the program are the 
Master Data File and a Problem Input Deck . At the end of a 
production run, the program lists the computational results. 

t j 

C-1 Master Data File 

The master data file consists of a sequence of 'data sets!. 
Each data set grouping has a common combination of conditions 
under which a series of specimens were inspected. These con- 
ditions are described in two 256 word records (header records) . 
The results of the inspection are called data points and are 
stored after the two header records. Each data point is 8 words 
long and contains: crack ID, detect code, crack length, crack 
depth, measured crack length, measured crack depth, surface 
finish and thickness. The 'data records' consists of 256 words 
which contain 32 data points in each. Each data set is labeled 
by a number which is unique to the data set. The data set number 

and the number of data records per data set are stored in the 

header records of each data set. The master data file is stored 
on magnetic tape in binary format, 256 words per record. 

C-2 Program Flow (Ref. to Table C-1 ) 

The first step in running the program is to read all the 

program options. The subroutine then reads the master data 
file to extract, data points for analysis. These data are 
stored on a local disk file for up to 10,000 data points. Each 
data point on this data file is described by four words, crack 
size, detect/no detect, crack ID, and data set number. The 
input options have already (either implicitly or explicitly) 
described a set of common conditions. Subroutine Order then 
rewrites the local data file in increasing crack size. 
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Figure G-1 Strueture of Main Routine in 
NASA. FTN Code 




Table C-1 


Glossary of Programs and Subroutines 
Used in NASA. FTN 


NASA - Main program to control the program steps flow 
in Figure 

ENTER - Routine to read in cards which contain the 

program options. The options are stored in commons 
for use by other routines. 

SORT - Routine that reads the master data file, sorts out 
data for analysis, then writes this data on local 
disk file. 

ORDER - Routine to sort the data on the local data file so 
that the order of the data will be by increasing 
crack size. 

POOL - Routing to determine whether a particular data set 
belongs to the rest of the sets being considered. 

POOLR - Routine to calculate probability of data sample 
belonging to a group having a known probability 
of detection - 

RJCT - Routine to zero out data points of a data set that 
has been rejected on statistical grounds. 

PCK - Routine to remove 'holes' in the local data file 

that are created by RJCT and to form a packed data 
file . 

HSTGRM - Routine to sort data into 32 size interval groups. 

OVLP30 - Routine to perform an analysis of the data by using 

the procedure known as the "OSP" scheme. 

Routine to perform an analysis of the data by 
using the procedure known as the 0PM. 
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SMOTHG 



STRGHT 

BIN 

DEFJC 

LST 

CKNRT 


Table C-1 (Continued) 


Routine to perform analysis of the data by using 
the procedure known as the *'RI" scheme. 

Routine to calculate POD at a specific oonfidence 
limit for a binomial experiment consisting of N 
measurements and n successes,. 

Routine to calculate the number of successful 
experiments which must be performed in order to 
know the lower limit probability of detection 
within a given confidence limit. 

Routine to list the results of the analysis. 

Routine which performs paging of the local data 
file. 


n-A 



If pooling is desired, routine POOL can be used to 
calculate the probability that each data set statistically 
belongs to the rest of the data sets that are collected 
together. Any data set that gets rejected is removed from 
the local data file by zeroing the data points. Routine PCK 
takes the local data file and re-packs it so that there are 
no zeroed points. All data sets removed are listed on the 
printer. The method of analysis determines the route the 
program takes next. If 'overlapping 60* is chosen routing 
OVLP30 "OSP” takes the local data file and processes the 
data directly. Routing HSTGRM is used to divide the data 
points into 32 groups which have equal crack size intervals 
ranging between a minimum and maximum input crack size. All 
crack sizes falling below the minimum are included in the 
first interval and all data falling above the maximum are 
included in the thirty second interval. Either the routine 
STRGHT "RI” or the SMOTHG "OPM" analysis procedure can be 
selected to analyze the data. The results are then listed. 

The program then returns to the beginning to read more cards. 

If there are no more problems to be solved, the program terminates. 

C-3 Sorting Option 

The program has two sort options. The first option uses the 
data set number directly. (See Figure 4-2 ). The user specifies 
the number of data sets to be considered, then specifies the data 
set numbers. The second option (Figure 4-3) j makes use of the 
header card information which includes 26 words or numerical 
codes for the alphanumeric data that is contained in the header 
records. By supplying values for these words, each header record 
can be compared to this 'master' input. No zero values are 
compared. Each time a match is made, .that data set is stored 
on the local data file, A maximum of 5 master header records can 
be combined per run. 

C-4 Program Limitations 

The maximum crack size that can be stored and analyzed is 
2.54 cm. The maximum number of data points that can be combined 
into a set is 1000. The maximum number of measurements that can 
be analyzed by the subroutine "DEFIC" which computes data 
deficiencies is 120. 
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Figure C-2 Sort Subroutine Flow V?hen Using Data Set 
Number Only for Sorting 
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C-5 Local Data File 


The local data file is a direct access file which 
occupies a continuous block or disk space. A paging method 
has been incorporated to avoid executive disk l/O. The 
subroutine CKNXT is used for paging. At any given time, 1024 
data points may be held in the core, therefore a disk access 
does not have to be made each time a new data point is addressed. 
The local data file has ten pages available for program use. 

C-6 Ordering Method 

A subroutine names "ORDER” reorders the local data file 
entries in increasing crack length then rewrites the ordered 
data file in place of the original unordered local data file. 

This ordered data is then used as input for data pooling and 
statistical analysis. 

C-7 Lower One-Sided Confidence Limits Calculations 

The binomial Equation (5) is solved by setting G equal 
to the confidence level desired and determining the value of 
p^ which satisfies the equation. A Fortran IV program which 
has been made operable in a PDO 11/45 computer to perform this 
function is given in Figure 4-5. pj is the probability of 
detection at the lower confidence limit. 

The procedure used to determine how many more measure- 
ments are required in each interval for the 95% confidence 
curve to reach the 90% probability of detection level is to 
solve Equation 8 for and . Figure 4-6 gives the listing 
of a Fortran IV program to perform this calculation. 
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Figure C-3 Sort Subroutine Flow When Using Master Control 
Records to Sort on Master Data File 
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SUBROLIT inf: B I N< BR 1 AR2 . AR3 . AR 1 9 ) 

1 IF(AR2)2.2..4 

2 AR10=0.0 

3 RETURN 

4 IF(AR2-AR1 >2.5,5 

5 AR 10=< 1 , 0-AR3 >tt<. 1 . 0/AR 1 > 

6 RETURN 

7 ATT=2.0*AR2 

8 IF<ATT-AR1>9,9,12 

9 AR4=AR2-1,0 

10 AR5=-1 .0 

11 GO TO 15 

12 AR4=AR1-AR2 

13 AR3=1 0-AR3 

14 AR5=-1 .0 

15 AR10=0.5 

16 AR6=1 .0 

17 AR8=0 . 0 

18 AR9=1 .0 

jci AR11=AR1 

20 AR7=( AR10*S;AR8 >*< < 1 . 0-AR10 )*»< AR1-AR8 > > 

21 I F< AR8-AR4 >22 , 27 , 22 

22 AR8=AR8+1.0 

23 AR9*AR9*AR11/AR8 

24 AR11=AR11-1.0 

25 AR7=AR7+AR9*<AR10»CAR8>*<< 1 .0-AR10>»»< AR1-AR8>> 
2e GO TO 21 

27 IFC AR3-AR7 >28, 28, 30 

28 AR20=ARie-AR5,'X 2 . 0**< AR6+1 . 0 > > 

29 GO TO 31 

30 AR20=AR10+AR5/<2.0**<AR6+1 .0>> 

31 CCC=ABS< AR7-AR3 > 

32 I F( CCC-0 . 000 1 >36 ,36,33 

33 AR6=AR6+1,0 

34 AR10=AR20 

35 GO TO 17 

36 1F(ATT“AR1 >6.6.37 

37 AR10=1 0-AR10 \ 

38 RETURN | \ 

39 END 


Figure c-4 Computer Code Used to Calculate Lower One-Sided 
Confidence Limit 



Sl®ROUT I NE DEF I C<; AR I .. AR2 .. FFF ■ AR4 > 

1 A=AR1-AR2+FFF 

2 AR4=0.0 

3 IF<AM,4.9 

4 AR4=29.0-AR1 

5 IF(AR4)6..6..7 

6 AR4=0.0 

7 RETIMW 
9 X=1.0 

10 AR5=0.0 

11 C=1.0 

12 CCC=(«1+AR4 

13 AR5=0.9**CCC 

14 C=< C/X >*< ARl+«?4+l . 0-X > 

15 DM3*AR1+AR4-X 

16 AR5=#«5+< 0 . 1»*X )*C*< 0 . 9*»DDD ) 

17 IF(A-X >18, 18.21 

18 IF(0.05-AR5>19. 19.7 

19 AR4*AR4+1 .0 

IF < AR4 .EQ. 100. ) RETURN 

20 GO TO 9 

21 X=X+1.0 

22 GO TO 14 

23 Em 


Figure C-5 Computer Code Used to Calculate Additional Measurements 
Required to Achieve 90% Probability of Detection at 
957o Confidence Limit 



e-8 DATA INPUT FORMAT 

The data are filed in mass memory by using a 'data set 
concept. All the common control parameters for a group of 
data points are loaded together. There are 26 such control 
parameters. The first 14 are the same for all NDE methods, 
the next 12 are different for each of the five NDE methods. 
The results of the inspection follow the control parameters. 
Eight numbers are used to describe each point. (Crack ID, 
detect code, crack length, crack depth, measured crack 
length, measured crack depth, surface finish, thickness). 

A typical control parameter listing is shown in Tabln 
C-1. Nine hundred eighty four flaw measurements have these 
parameters in common. The data in Table C-1 can be compaeted 
for computer storage into the format shown in Table C-2. A 
special data set listing like that shown in Table C-1 can be 
prepared from the line of integers shown in Table C-2 by 
using the parameter key included at the end of this appendix. 
Four of the 984 data points for data set # 1 were entered 
onto each of 246 lines in the format depicted in Table C-3. 
Each complete data set is terminated by a 0000 entry in 
Columns 1 through 4 of the digital computer data sheet. 
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Table C-1 Data Set Parameters 
for Data Set Number 1 


DATA SET Nl«BER 1 


l> 

2 > 

:^> 

4 > 

5 > 
b.’ 
i 7 ) 

; 8> 
i 9 ) 
^0) 

!12) 

| 13 ) 

Il 4 ) 


5 

4 

0 

1 
1 
0 


2 


3 

3 

1 

1 


NDE rCTHOD 
COMFWY MAME 
PRiJGRAM 10 

material 

OEFECT TYPE 
OPERATOR ID 

qualification 

INSP. ENUIROWCNT 
INSP. PROCEDURE 
DATA RECORD TYPE 

mode of scan 

reference STANDARD 
defect MATERIAL 
PART GEOf«TRY' 


ULTRASONIC 

EDH 

QUNLIFKD according to MIL-STO-453 

✓ MULTIPLE FLAW SPEC. 
>TD. OR SCOPE DISPLAY 

HBOiM^liCAL SCAN AND INDEX 
HOLE 


A 


FllAT PUATE 


15 > 1 ULTR<!«0N1C METHOD 

te> 4 FREWEHCV 
17'* 1 XMITTER TYPE^SIZE 

18 ' 1 RECEIUER TY^SIZE 
19 > 1 EQUIPMENT T^ 

20 } 0 GAIN SET 5; OF SS 
21 ■> 0 ALAW S^ Jj OF W 
22) 1 TYPE OF COUPLING 

23 ) 1 #*IGLE OF INCUT"' 

24 > 1 INDEX INTER* 


I a: •« 


* SH^ 

> t0ie 


PULSE ECHO 
ICC HZ 
FiATF^ . 

FLAT FACE > .95 CM 
™l9iT^l«N PULSER/RECIEUER 


Nff 

hater bcrsion 

2P.25 DEG ^ ^ 

■ 51 A pH < 175 IN > 



G t “ 


TaBle C-2 Data' Set: Shtry for Compact Storage of 
Data S.et Parameters 


Computer Input: 


DIGITAL COMPUTER DATA SHEET 






MEEMEM 






1 

■i 

1 

6 

■mm 

HjjjHg 

imimQ 


31 :32 

! r- i ' r .'T V ■■! 

33 ; 34 : 35 : 5S ; 37 : 38 : 3S i ; 4 : , 42 ; 43 i 44 1 46 46 47 i 48 

49 : 50:5' 52 

1 

■■ 


z 

M 

0; |7 

/ 

S\ ;/! \[\ 1 


' ! ‘ : ! i i / : > i i ■ / ! 1 i ! 

; i 1 : 


^ \ ! 
; 1 


— 

f L 

[ 1 

III: 

'^ \ \ \ \ \ 1 \ • \ 



i i ; ; 




Computer Output: 


5 4 2 110 7 12^331 1 141 1 1001 I 1 








0S vs 0S 060S6906 


00333 01 0300I9000I 0S 3S 03 0106 90S 


0000 

00110 01 0 0 0S 13 




J3 ^ 





to O 
♦H ^ 









CQ 

•H U 


■u 


to 



& 


OJ 



(1) 


C 

(U (U 


Q 



O 



c 

o 

cd D 



cd 

•r-l 

4-{ CO 

■u 

o 



U to 

fX 

CO 


fH 

P 0) 

0) 




w s Q 

u 



£ 

42 




■u 

4J 

<U 



W) 

bO 


• 


c 

P 

O 

Q 

T3 

cu 

(I) 

U 

• 

(U 

t-3 

h4 


M 




•U 


P 


4*5 

o 


CO 

CJ 

U 

QJ 

O 

CO 

CO 

CO 

■u 

cO 


Li 

Li 

(U 

Lt 

S 

O 

U 

Q 

U 


SuTi^ST'i J0qndmo3 


1 ^ 

1 

s 


h 

U-J 

— 

0 

z 

!o!b 

1 1 

o|Sibl‘^ 

! 1 I 

0 |fc 

__J 


1 \0\orzrZZ^ |0 


o 

o 

O 

O 

QIC i 1 

! 

08 1 

^ 

..._.. 

8Z 


9i 

5Z 1 W 
^ 

£Z 

2Z 

! i 

\Ll 0L> 69 

,. ,.i 1 

89 1 i9 
1 

99 j 59 1 ^9 

£9 

29 

f -! f- -f — -1 — ■ 

isj 09 1 65 '85 |z5 I 95 ^ 55 ‘ K ' £C 

25 

— ^ ^ — 

! 5 1 05 ^ 67 
i L 

Bi 



1 [■■■1 T T T 

l^;\ 9t?l SfrUt 1 i 271 

1 1 Lli I....! . 


o 





— 


; : : ! : ■ i 


: ^ ' ] ] \ \ \ [ : 
i . : :' ^ i 1 1 ' : ^ ^ 



OpjO 

r\ 

J 

! : 



o 

o 

' O b; '^ 0 3 

"o 

oil Mi^: ^ ^0: [Q\3 

1 

1 

^1 i 

; I 


T ; ; 

1 Or * 6f : 9? 

! ; 

Li I S£ 155 


mm 



9 

5 

y 1 £ 1 2 

1 


::^ndui jaandinoo 


nOOOOn p9:iBU§TSaa axTd 
JO pu3 S9Tj:jua SuTwoqs 

^BTiuoa Xjrjua azjs c-o ^iq^x 
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NDI tCTHOO 


NOE METHOD 

1 EDDY CliRRENT 

2 PENETRANT 

3 MAGNETIC PARTICLE 

4 RADIOGRAPHY 

5 ULTRASONIC 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


Key 


data source 


C<»rANY NAME 

1 (SHERAL DYNAMICS FU 

2 CONUAIR 'SAN DIEGO 

3 BOEING COMMERCIAL 

4 MARTIN MARIETTA 

5 ROCKWELL INTER. B-1 

6 LOCKHEED GA. 

7 MCDONNELL DOUGLAS 

8 AFML 

9 TRW 

10 GE > EUENDALE OHIO 

11 FAIRCHILD HILLER 

12 LOCtOCED CALIF . 

13 ROCKWELL INTER SPACE CENTER 

14 KCING WICHITA 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 



program 10 


MATERIAL 


0 

1 

Ln 


PROGRAM ID _L 

1 SENSl LIMITS OF PROO. NDE METHODS 

2 DETECTION OF FATIOJE CRACKS 

3 EUAL OF RELI . SENSl OF HOE METHODS 

4 USAF Aie SPO OEHO PROGRAM 

5 USAF B-1 SPO OEHO PROGRAM 

6 DETECTION OF TIGHTLY CLOSED FLAWS 

7 

8 
9 

le 

II 


12 

13 

14 

15 

16 

17 

18 
19 



28 

21 

22 

23 

24 


material 

1 ALUMINUM 2219-T87 

2 ALUMINUM 2824 

3 4340M STEEL 278-380 KSI 

4 TI-6AL-4U 

5 
€ 

7 

8 
9 

18 

11 

12 

13 

14 

15 

16 

17 

18 
19 
28 
21 
22 

23 

24 



DEFECT TYPE 


OPERATOR ID 


0 

1 

a^ 



DEFECT TYPE * 

1 FATIGUE CRK.tlO CVCLE/REMOUE EOH 

2 ELOX SLOT 

3 SAW CUR 

4 WELD DEFECT <LACK OF FUSION) 

5 tCLD DEFECT (LACK OF POCTRATION) 

6 tCLD DEFECT (POROSITY) 

7 FORGING FLAMS WITH OXIDE IN FLRH 

8 HYDROGEN EflBRITTUNiW 

3 HVDf«)G£H inducted O^INDING CRA CK 

10 FATIGUE CRACK ADO. CYCLES / RENOUE EDM 
U 
12 

13 COf-ff»RESSED NOTCH FLAM 

14 FATIGLC CRACKED MELOS 

15 

16 

17 

18 

19 ! ’ 

28 ' 

21 

22 

23 

24 


OPERATOR ID 

1 A 

2 B 

3 C 

4 0 

5 E 

6 F 

7 G 

8 H 

9 I 

10 J 

11 K 

12 L 

13 N 

14 H 

15 0 

16 P 

17 Q 

18 R 

19 S 

20 T 

21 U 

22 U 

23 H 

24 X 



IX- 


QUALIFICATION 


o 


QUALIFICATION 

1 LEUEL 1 

2 LEUEL 2 

3 LEUEL 3 

4 FIELD SERUICE TECHNICIAN 

5 LABORATORY TECHNICIAN 

6 LABORATORY ENGINEER 

7 QUALIFIED ACCORDING TO HIL-STO-453 

8 TECHNICALLY QUALIFIED 

9 

le CERTIFIED UNDER BOIEHG A.C. 5953 

11 

12 

13 

14 

15 

16 

17 

18 


19 


20 


21 


22 


23 

24 


INSP ENUIRONMENT 


INSP. ENUIRONMENT 

1 PRODUCTION 

2 LABORATORY 

3 FIELD SERUICE 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 



INSP. PROCEDURE 


INSP. PROCEDURE 

1 STD. INSP. / SINGLE FLAM SPE^ 

2 STD INSP " MULTIPLE FLAM SP EC. ^ 

3 NON STD. INSP , SINGLE FL^ 

4 NON STD. INSP. / MULTIPLE FLAM SPEC 


MIL-STD-453 / MULTIPLE FLAM 


4k W ra 9 u> (D ■>! at til * <4 (U <9 00 ■'J Ok OI A (4 M 


WITA RECORD TVPE 


DATA RECORD TYPE 

rmJAL RECORD OF UISUAL DISP^ ^ ^ 
MANUAL RECORD OF METER OR SCOPEDISPLAV 
MECHANICAL RECORD OF UISOAL DISPLAY 
RECORD OF METER OR SCOPE DIS P^V ^ 

COMPUTER RECORD OF METER OR SCOPE DISPLA 



rWOE OF SCAN 


0 

1 



NODE OF SCAN 

1 riANUAL HAND SCAN 

2 MECHANICAL SCAN ' 

3 MECHANICAL SC^ AJC INDEX 

4 COMPUTER CONTROLLED SCAN 

5 

6 

7 

8 
9 

18 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


REFERENCE STAf«»RO 


REFERENCE STANDARD 

1 ELOX SLOT 

2 FATIGLC CRACK 

3 FLAT BOTTOM HOLE 

4 FORGING FLAH 

5 SAM CUT 

6 SIDE DRILLED HOLE 

7 UERTICAL DRILLED HOLE 

8 0.839687 <l/'64> FBH 

9 0 079375 ( 2/64) FBH 

10 0 . 1 19063 < 3/64 ) FBH 

11 0.15875 (4/64) FBH 

12 0.198437 (5/64) FBH 

13 REF. PANEL USED / DESCRIP. NOT KNOWN 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 
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DEFECT MATERIAL 


DEFECT MATERIAL 

1 AIR 

2 MATER 

3 

4 

5 

6 
7 
& 

9 

le 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


PART GEO. 


PART GEOMETRY 
1 FLAT PLATE 

o 

3 

4 

6 MELDED BUTT JOINT 

7 INTEGERALLY STIFFENED PANB^ ISP) 

5 ICLDED BUTT JOINT HITH CROMMS 
9 I S.P RIUETED TO FLAT PLATE 

10 SOLID CYLINDER 

11 FILLETED SOLID CYLINDER 

12 TANDEM 'T* 

13 HOLLOW CYLINDER 

14 hWLLOM FILLETED CYLINDER 

15 FLAT BAR 

16 

17 

18 

19 

20 


21 

22 

£3 

24 



SPECIAL 

KEY FOR EDDY CURRENT 
DATA 


1 NDE METHOD 

2 COMPANY NAME 

3 PROGRAM ID 

4 MATERIAL 

9 DEFECT TYPE 

6 OPERATOR ID 

7 QUALIFICATION 

8 INSP. ENUIRONMENT 

9 INSP. PROCEDURE 
le DATA RECORD TYPE 

11 MODE OF SCAN 

12 REFERENCE STANDARD 

13 DEFECT MATERIAL 

14 PART GEOMETRY 


15 EQUIPMENT TYPE 
DIAMETER OF COIL 
CONF. /SHAPE OF COIL 
FREQUENCY 

TYPE OF EC RESPONSE 
LIFT-OFF COMP. _ 
li SIGNAL PROCESSING 
22 INDEX INTERUAL 


17 

18 
19 
28 
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IS FREQUENCY 


FREQUENCY 

1 100 KHZ 

2 20 KHZ 

3 

4 

5 

6 
7 
ft 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 



-24 


19 TYPE OF EC RESPONSE 


TYPE OF EC RESPONSE 

1 AMPLITLOE 

2 PHASE 

3 

4 

5 
■6 

7 

8 
3 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


20 LIFT-OFF COMP. 


■-1"« [l^ C.»PE.««IION 

2 LIFT-OFF COMPENSATED FOR < 3MIL SHIM) 

3 

4 

5 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 
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21 SIOML PfWCESSING 


SIGNAL PROCESSING 

1 STRAIGHT AtPLIFlCATION 

2 

3 

4 

C 

.j 

6 

7 

8 
Q 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


22 index INTERMWL 


INDEX IHTERUAL 

1 3048 CN < .125 IN) 

2 .0508 CM ( .020 IN) 

3 

4 

5 

6 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 



SPECIAL 

KEY FOR LIQUID PENETRANT 
DATA 


1 NOE METH(>0 

2 COMPANY NAME 

3 PROQ^ i O 

4 MATERIAL 

5 DEFECT TYPE 

6 OPERATOR ID 

7 QUALIFICATION 

8 INSP. ENUIRONMENT 

9 INSP. PROCEDURE 
le DATA RECOK) TYPE 

11 MODE OF SCAN 

12 REFERENCE STANDARD 

13 DEFECT MATERIAL 

14 PART GEOMETRY 


15 penetrant type 

16 DEMELOPER TYPE 

17 CLASS OF PENEtRANT 

18 REMOUER^MULSlFiR 
lA APPLlCAflON MEtHOO 


DHELL 
DEUELOPtNG 
HASH TIME 
t3 LIGHT IFffEHSITY 
24 REMOUALs^f>P£-ClUEAMlNG 


C-9f> 


15 PENETRflNT TYPE 


0 

1 

to 

•O 


PENETF»WT TYPE 

1 URESCO P-151 

2 

3 

4 ZL-2A - URESCO P-133 t P-134 

5 URESCO P-149 

6 

7 

8 
9 

18 

11 

12 

13 

14 

15 

16 

17 

18 
19 
28 
21 
22 

23 

24 


16 OEUELOPER TYPE 


OECCLOPER TYPE 
1 URESCO 0499C 

4 NAGM8FLUX ZP-4A ,-5.«.-13* <• URESCO 4996 

5 URESCO D499C 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 



t7 CLASS OF F€NETRANT ,18 REHOUER/EMULSIFER 



in ID r. 00 <Ti wto in ao y 

^ ^ ^ ^ W cJ W; 



KEPKODUCIBILITy OP THE 
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19 APPLICATION METHOD 


APPLICATION METHOD 
1 HAND BRUSH 


4 

5 
S 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


20 OHELL TIME 


DWELL TIME 

1 30. MINUTES 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 



21 DEUELOPING TIHE 


22 TIME 


OEICLOPING TIME 

1 30 MINUTES 

2 

3 

4 

5 

€ 

"7 


9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


HASH TIME 

1 60 MINUTES 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
2Z 

23 

24 



i2l LIGHT INTEHSITY 


light intensity 

1 1350 LUMENS^ «>n- cti ttp 

2 125 FT-C0HDLES • 15 IN FROM FILTER 

3 

4 

tz 

6 

( 

n S 

^ 9 

10 
It 
12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


24 REHOt»AL^T>f!E-CLEANIMG 


RENOUAL /PRE-CLEAN ING 

1 MARTIN HARIETTA < PER. NASA CR-2369> 

2 CLEANED BY ALCOHOL IN ULTRASONIC CLEAHEI 

3 

4 

5 

6 
7 



SPECIAL 

KEY FOR MAGNETIC PARTICLE 
DATA 


1 NOE METHOD 

2 COMPANY NAME 

3 PROGRAM ID 

4 MATERIAL 

5 DEFECT TYPE 

6 OPERATOR ID 

7 QUALIFICATION 

8 INSP. ENUIRONMENT 

9 INSP. PROCEDURE 
le DATA RECORD TYPE 

11 MODE OF SCAN 

12 REFERENCE STANDARD 

13 DEFECT MATERIAL 

14 PART GEOMETRY 


19 EQUtPMlNT 

16 PROCEOURE 

17 MAG. PARTICAL TYPE 

18 SUSPElfelON r(T»E 
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t$ EQUIPMENT 


i6 PROCEDURE 


EQUIPHENT 

1 TYPICAL AERO-SPACE EQUIP. 

2 PARKER RESEARCH CO <1100 00-260 ) 

3 

4 

5 

6 
7 


11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


PROCEDURE 

1 NET CONTINUOUS FLUORESCENT PRCE 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 
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17 MAG. PARTICAL TYPE 


MAC P»«TiCAL TYPE 
1 MAGNAFLUX 14A 
Z MAGHAFLUX 14A t 14AM 

3 

4 

5 

6 

7 

8 
9 

le 

11 

12 

13 

14 

15 

16 

17 

18 
19 
28 
21 
22 

23 

24 


K IS *- 8 VO S N 5 5 S S3 fo 5 O) -VI Ul ♦ w fv) 


18 SUSPENSION T'rPE 


SUSPENSION TYPE 

OIL & UATER BASE 

14A IN OIL / 14AM IN AEROSOL CANS 



SPECIAL 

KEY FOR RADIOGRAPHY 
DATA 


1 NDE METHOCf 

2 COMPAf-IY NrtME 
3t PROGRAM in 

4 MATERIAL 

5 DEFECT TYPE 
b OPERATOR ID 

? QUALIFICATION 

8 1N3P ENUIRONMEMT 

9 IN3P. PROCEDURE 

10 DATA RECORD TYPE 

11 MODE OF SCAN 

12 REFERENCE STANDARD 

13 DEFECT MATERIAL 

14 PART GEOMETRY 


IS RADIOGRAPHY 

EQUllPMENT T'lTE 
17 SOURCE ENERGY 
48 SOURCE STRENGTH 
19 MINOOM MATERIAL 
» TYPE OF FILM 
il EXPOSURE TIME 

22 SOURCE TO FILM DISTA 

23 ANCLE OF INCIDENCE 
£4 densitometer READING 
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t5 RrtDlOGRi^PHy 


1 

ON 


RAOIOGR«W>HY 

1 X-RAY 

2 NEUTRON 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


16 eouiipment type 


EQUIIPHENT TYPE 
1 

i. 

3 

4 BALTOSPOT X-RAY 

5 NORELCO X-RAY 150 KU 24HA 


6 


7 


8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 
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t7 SOURCE ENERGY 


O 


SOURCE tNERi^ 

1 30 KU FOR 1K4 ^ ^ Pgg- 

2 40 KU FOR .5207 CM «. 

3 45 KU FOR 3300 CM , 78 KU FOR 

4 


t> 

7 

8 
9 

10 

11 

12 

13 

14 

15 
18 

17 

18 

19 

20 
21 
22 

23 

24 



IS SOURCE STRENGTH 


1.27 CM 


SOURCE STROJGTH 

1 20 MILLI-Atf*S 

2 3 MILLI-OMRS 

3 

4 

5 

6 
•» 
t 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 
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19 UINOOM mTERlM. 


MINDOW rWTERIAL 

1 BERYLLIUM 

2 

3 

4 

5 

6 
7 

a 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 
19 
28 
21 
22 

23 

24 


2 » TYPE OF FILM 


TYPE OF FILM 

1 K008K , TYPE M 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 



2t E>«>OSURE TIME 


22 SOURCE TO FILM DISTrt 



0 

1 

LO 

VO 


EXPOSURE TIME 


1 

2 

3 

4 

5 

6 


, MIN. FOR 1524 CM AL 
15 HIN FOR 5207 CT1 RL ^ 

1 5-3.0 MIN. <THICK-EHERGY D EPEND . ) 

I 5-2.25 MIN. (THICK-ENERGV OEPEW. > 


8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 
19 
29 
21 
22 

23 

24 



SOURCE TO FILM DISTA 

1 117 CM. 

2 122 CM. 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 



21 AHae OF INCIDENCE 


24 OEN^ITOHFTEP F-EAC'IHG 


f^INaE OF INCIDENCE 

1 0 e DEG <NORIiM.> 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


DENSITOMETER READING 
1 25-3.5 

tm 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 



SPECIAL 

KEY FOR ULTRASONICS 
DATA 


1 NDE METHOD 

2 COMPANY NAME 

3 PROGRAM ID 

4 MATERIAL 

5 DEFECT TYPE 

6 operator id 

7 QUALIFICATION 

8 INSP. ENUIRONMEHT 

9 INSP PROCEOLWE 
le DATA RECORD TYPE 

11 MODE OF SCAN 

12 REFERENCE STANDARD 

13 DEFECT MATERIAL 

14 PART GEOMETRY 


b ULTRASONIC METHOD 
FREQUENCY 

17 XMITTER TYPE/«12E 

18 RECEIUER TYPE/'SIZE 

19 EQUIPMENT TYPE 
2 » GAIN SET OF SS 

21 ALARM SET J: OF SS 

22 TYPE OF COUPLING 

23 ANGLE OF INCIDENCE 

24 INDEX IHTERtlAL 


C-4I 
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15 ULTRASONIC HETHOO 


ULTRASONIC METHOD 

1 SHEAR = PULSE ECHO 

2 SHEAR PITCH CATCN 

3 DELTA SCAN 

4 CO»f>RESSIONAL WAUE > PULSE ECHO 

*5 COMPRESSIONAL WAUE •• TNROOGH TRAMS. 

6 SOftFmM NAME 

7 SHEAR ♦ SURFACE = PULSE ECHO 

8 SHEAR ♦ SURFACE + LONG. ^ PULSE ECHO 

9 
10 
11 
12 

13 

14 

15 
IS 

17 

18 

19 

20 
21 
22 

23 

24 


16 FREeWEHC'/ 


FREQUENCY 

1 1 MEG. HERTZ 

2 2.25 MEG fC. 

3 5 MEG HZ. 

4 10 MEG HZ. 

5 15 HEG HZ. 


6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 
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17 XHITTER TYPE^SIZE 


XMITTER TYPE 'SIZE 

1 FLAT FACE - 95 CM 

2 FLAT FACE . 635 CM 

3 FLAT FACE . 1.27 CM 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 


18 RECEIUER TYPE/SIZE 


RECEIUER TYPE SIZE 

1 FLAT FACE , .95 CM 

2 FLAT FACE . .635 CM 

3 FLAT FACE > 1 27 CM 

4 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 
19 
28 
21 
22 

23 

24 
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19 EQUIPMENT TYPE 


EQUIPMENT TYPE 

1 UM 715 , 10N PULSER-'RECIEUER 

2 

3 

4 

5 

6 
? 

8 

9 

le UM 715 . USIP 11 * 4240 
11 
12 

13 

14 

15 

16 

17 

18 
19 
28 
21 
22 

23 

24 


28 GAIN SET ^ OF SS 


GAIN SET •; OF SS 

1 80 SCREEN SATURATION 

2 

3 

4 

5 

6 

7 

8 
S 

10 

11 

12 

13 

14 

15 

16 

17 

18 
19 
28 
21 
22 

23 

24 
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2f AMCLE OF INCIDENCE 


ANGLE OF INCIDENCE 

1 27.25 DEG 

2 18.00 DEG 

3 27.00-27 75 DEG. 

4 32.00 DEG 

5 80 e DEG. (N0I91AL> 


24 INDEX INTEEtJiAL 


INDEX INTERiW, 

1 .318 CM < 125 IN. J 

2 .081 CM (.032 IN> 

3 .051 CM. (.020 IN> 

4 076 CM < .030 IN) 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 
Id 
20 
21 
22 

23 

24 



APPENDIX D 


COMPUTER OUTPUT - NDE RELIABILITY DATA 

The data for Figures D-la, D-lb, and D-lc were obtained 
with an ultrasonic surface wave technique and at a frequency 
of 10 MHz. The abscissa is the surface length of a fatigue 
crack. The NDE technique (ultrasonics) is given on the upper 
left hand corner of the figures immediately after the date 
when the curves were plotted. Test 1, Test 2, or Test 3 is 
written on the same top line of the page. Test 1 refers to 
the range scheme where the lower one-sided confidence limit, 
p^, was calculated for equal flaw size intervals. In 

Figure D-la the flaw size interval is 0.038 cm. Test 2 (Figure 
D-lb) refers to the use of the optimized probability method to 
calculate the Test 3 (Figure D-lc) refers to the use of 

the overlapping sixty point scheme to calculate the p;|^. The 
top line of the computer output also contains the name of the 
company or the agency that published the report from which the 
data were taken. In Figure D-1 the company is Martin Marietta 
of Denver, Colorado. The test specimen martial type is 
identified in the figure caption on the bottom of the page or 
in Table 5-1 of Section V where the data set number can be 
matched with the number in parenthesis in the upper right 
hand side of each figure. 

The first column of the tabulated results in these 
figures lists the range numbers. The second column gives 
the minimum crack length of each range and the third column 
gives the maximum crack length of each range.* The fourth 
column gives the total number of measurements or observations 
(N) for each size range and the fifth column gives the number 
of detections (n) for each size range. The probability of 
detection at 507o and 95% confidence level** is given in the 
sixth and seventh columns respectively. The last two columns 
list the number of new measurements that must be made with no 
misses and with one miss, respectively, to achieve 90% 
probability of detection at a 95% confidence level. The zeroes 
in these last two columns indicate that either no measurements 
need to be made or the number is too large for practical 
cons ide rat ion . 

* Tabulated data give crack lengths in mils while the graphs 
give both mils and cm scales. This dual labeling is offered 
as a convenience for the design engineer o 
** Hereafter POD90(CL95) will be used to refer to a 95 percent 
confidence that the true probability of detection equals or 
exceeds 90 percent. 
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All the reliability curves discussed in this appendix 
are presented in the above format. Additional information 
such as flaw, type, material alloy type, contract or 
report identification number, and other pertinent parameters 
associated with the data used to generate these reliability 
curves and tables are included wherever possible. 
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Lower Confidence Limit 


(a) Range Interval Method of Data Cumulation 
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Figure D-1 Probability of Detection for 2219-T87 A1 Using 
Ultrasonic Surface Waves, Fatigue Cracks in 
Flat Plates. Lab. Env. 
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(b) Optimum Probability Method of Data Cumulation 
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One Sided Lower 
Confidence Limit 
at the 95% Con- 
fidence Level 
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Figure D-1 (Continued) 
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r lapping Sixty Point Method of Data Cumulat 
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Figure D-1 (Concluded) . 


Lower Confidence Limit 


(n) Range Interval Method of Data Cumulation 
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Figure D-2 (Continued) 
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Figure D-3 Probability of Detection for 2219-T87 Al Using 
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(c) Overlapping Sixty Point Method of Data Cumulat 
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(b) Optimum Probability Method of Data Cumulation 
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Figure D-4 (Continued) 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Date Cumulation 
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"(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Figure D-10 (Continued) 



Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-10 (Concluded) 
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Figure D-11 




Lower Confidence Limit, Px 


(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 


03-JUL 

-75 ULTRASONIC: 


TEST 

3 .. ROCKWELL 

SC . ' 

(11) 

RrtNCE 

MIN LN LN 

N 

DET 


95>. 

0 MI 

5S 1 MISS 

1 

0 * 

n * 

' 0 

0 

0 

0 

0 

0 

'i 

0 

, 0 

. . ' 0 

0 

0 

0 

0 

0 

3 

0 

0 

0 

0 

0 

0 

0 

ft 

4 

0 

0 

0 

0 

0 

0 

0 

0 

5 

0 

0 

0 

0 

0 

0 

0 

0 

6 

0 

0 

0 

0 

0 

0 

0 

0 

7 

0 

0 

0 

0 

0 

0 

0 

ft 

8 

0 

0 

0 

0 

0 

0 

0 

0 

9 

0 

0 

0 

0 

0 

0 

0 

0 

iO 

0 

0 

0 

0 

0 

0 

0 

ft 

11 

0 

0 

0 

0 


0 

0 

0 

12 

0 

0 

0 

0 

0 

0 

0 

0 

13 

0 

0 

0 

0 

0 

0 

0 

0 

14 

0 

0 

0 

0 

0 

0 

0 

0 

15 

0 

0 

0 

0 

0 

0 

0 

0 

16 

0 

0 

0 

0 

0 

0 

0 

0 

17 

0 

0 

0 

0 

0 

0 

0 

0 

18 

0 

0 

0 

0 

0 

O 

0 

0 

19 

0 

0 

0 

0 

0 

0 

0 

0 

20 

0 

0 

0 

0 

0 

0 

0 

0 

21 

7 

49 

52 

27 

50 

39 

0 

ft 

22 

31 

63 

60 

46 

75 

65 

0 

0 

23 

49 

69 

60 

50 

82 

♦ **• 

0 

0 

24 

63 

79 

60 

50 

82 

73 

0 

0 

25 

70 

87 

60 

51 

83 

75 

94 

100 

26 

79 

104 

60 

49 

80 

71 

0 

0 

27 

87 

131 

60 

49 

80 

71 

0 

ft 

28 

105 

158 

60 

47 

77 

67 

0 

0 

29 

131 

269 

60 

50 

82 

73 

0 

0 

30 

162 

329 

€0 

59 

97 

92 ^ 

0 

1 

31 

275 

426 

60 

58 

95 

89 

1 

16 

32 

330 

500 

60 

57 

93 

87 

16 

29 




Crack Length 

(Mil)* 



0 

100 


200 

300 


400 


500 



D-35 


'Z^ '!I O •£' f >- O ^1 Cl' C ’ O d' *?• O G' O O Cl C& S' O O O O O O 2 

“ " 'o f - rr * *t rf . C'i ^ 


_ J ^; C ^ 0 S > V £ ll '^• C ‘ JG '( y >^- 0 ClG • 0 CM ^ S • f ‘ l 0 C * 0 S '^- 000000 '^ 00 g 

uj r > v:«w CJ 04 «-« ’-• ^ 

ZS. Cl 


, ? 04 ® Ki CO CO N. ifi r- '■£} ro *xi 01 o c? k m u"; Q <Ti f - m k jr w in V) in 10 co to 

- u*) cj ti"* '^ ^- r>- 00 U) 1^. f'. lo ro 04 00 fCi *i> ^ to f\i vo co 

<T. 


. . ; • 0 4 cr. a t cci h- ro ^ S' -• \o o a « Gr o o ^ VD ch o 2 j tr- jr N 3" CO p ® o Q o ^ y 

C '^' Oh - COOOO " tOO 0 ’ iOM ^ IOr ^ r '- ( X ) 0 ‘»^^-<^^ 00 ^^<^>' i ) 00 ^^) N ■ l 01010 IO < T > C ^» 

-10 


tSi— •x)roc0 04rwr-i0V0CD040jr00joorrr^ror'-vD00(M00^^<vi-'<«-'»-*«-'C0jo 

UJ ^ fO ^ ^ ^ ^ »-» 11 / 


■»H MOM "/ 


Z Z 04 < D 
o _J C'4 ro 
CO 

<rx 

a:<r 


f ' 4 rwCMrs .^ vD ^ rw -^ ior '- ooi ^ ojio ®' i > oJiDOJCM ^ rooo ^ w 2 ^ J ^ 

iovf > oo ( T >'-' C ' 4 ’ t ' ioN ®( y > 

c \ j ( vjojcvjMMrororororo -«-' i »-'^^' tor < 


=! -J< 


uocoi < r « fo ® in <^ roooc ^ j ® oo ^ oocopio ® rj 00 jgp 3 :; gjow ^ oo 3 

ojojC ' jc \ jo 4 rorororororo ^' T ^^^“ 


i -^ C '« jro '< t ' io '-^ r '-® ONO ^ pjr ' 0 ^ iocori -®< y 4 ®'-' 04 rO '» t ‘^ cD ^ TOOS®;^oi 


Crack Length (Mils)^ 


o 

m 


o 

o 

<t 


o 

m 

on 


o 

o 

CO 


o 

m 

Cv] 


o 

o 

eg 


o 

m 


o 

o 

I — 1 


o 

m 


I 

C 


5 

•H 

0 

t — 1 

0 

.-3 

0 

0 

1-3 

0 


> 

0 

T3 

0 

m 

h-3 

0) 

c 

av 


T3 

0 


0 

•H 

t3 

0 

0 

cn 

•«M 

X 

c 


'U 

44 

0 

0 

c 


TJ 

C 

0 

4J 

•tM 

0 

u 

Cd 

VR 




-I 1 1 1 1 ± 4- 

O ' ^ Q ® ® ® w 

r>. \0 10 TT M w -« 




VO 


in 


bO 

CO 

• 

C ^ 

>, 


0 

c 

CO 

cd 

(i3 

1=^ 

u 


P 

•' 

rM 



< 

0 

cd 


0 

1-3 

r- 

bO 


00 

•H 




# ' 

t 

cd 

Pi 

0^ Pm 


r-l 


R 

CM 

TJ 

0 

CM 

0 

44 


rC 

Cd 

R 

0 

U 

0 

4J 

0 

CR 

w 

a 

B 

0 

Up3 



0 

• 

Jo 


•H 

rCU 

4J o 
D 0> 
C4-> 
<U Q) 

X 4-1 
U O 
(0 

n Jo 

Ou 

•r4 

•H 

rO 

cd 

o 

u 

Pm 


No 


TJ' 
(Uf 
S4 

^ro 
.Q 

Q)'^ 

S 

CO 

<u 

4-> 

cd 

r-l 


O 

•H 

c 

O 
CO PM 
Cd 

u u 

4J Cd 
I — I r*M 


CN 




® 


rM 

o 

cu 

u 

p 

bO 

•H 


jawcxi 


‘ ijiuitt ; 0 ouapTg : uo 3 



^ .-n c o o o i'< r - o i;> 'r> S' q c g* f •- o t •’•J o o o <s> O © ® O o O 

nj ^ <T, 

to u*. ^ 

o‘> <t 

H c G< G‘ G'ChO O © o© ©© © ©©^ ® ® ® ® ^ ® ® 

uj K r> f'i 

3 0 o 

•id o 

8 ^ 

-J< o 

^in 

’-' CO CO 

O © © ® © © © © © © © ® © © © © © © OOOOOOO©©©©©®© rH 

^ o 

O J Q 

CO 

^ »H »^ *«< «-i «-i «-• IM 00 o 

c 

0> CM 

>J 

-7- ro CT) ® r- <s to ro (M © © ro © ® ® <T) '-£> <x» VO oj 04 M* ID 0^ 5" t S' S S£ fi 

^wcyroM'ro'0©®<^<y>ff»^K?SS^2 ^ ^ 

^r^0J04-^ <y ^^^^^^04<vicg-^ ^} Q 

5-1 CM 

O 

o ^ o 

z3^jy)04Noji^-Hvo*4N-Hif)is.©oo-04ioovoojvo(vj(yr?f2®if;£J3 “D 

(f, ^ <vic*j04<MC‘orororororo(‘9^^'^^'’TCTi 

<r X 

a: ^ o 


3fs-irMO^**“^'^foro©’*’’T©o o M" ojtvioiOJOjoafOMWCowrojoj^^'f^Si 

_i C4 Cvi lO lO ID lO © © 'X> ID ID ID©©©©©©®©® ©® ©VOtt©© 
IDZ 

V ^ 

Rw-MM^io>£.f.cD<7.2-«22!22t:22S3wSi!3SSSRiaa^:f;f^ 

ft 


o 



Figure D-12 (Continued) 


Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-12 (Concluded) 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Ciomulation 
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Figure D-13 (Concluded) 
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(a) Range Interval Method of Data Cumulation 
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Figure D-14 Probability of Detection for 2219-T87 Al Using 

Liquid Penetrant. Etched Fatigue Cracks in Flat 
Plates Measured by Operator H. Lab, Env. 
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(b) Op timum Probability Method of Data Cumulation 
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Figure D-14 (Continued) 
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(c) Overlapping Sixty Point Method of Data Cumulati 
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(a) Range Interval Method of Data Cumulation 





aouapTjuo3 jomo^ 



Crack Length cm 
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Plates Measured by Operator I, Lab. Env. 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Figurif’b-lS (Continued) 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulati 
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(b) Optimum Probability Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-19 Probability of Detection for 2219-T87 Al Using 
Liquid Penetrant. Etched Fatigue Cracks in 
Flat Plates Measured by Operator M. Lab, Env, 
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(b) Optimum Probability Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Figure' D-20 (Continued) 


D~61 



(c) Overlapping Sixty Point Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Figure D-21 (Continued) 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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Figure D-22 



Lower Confidence Limit 
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Figure D-22 (Continued) 



(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-22 (Continued) 




Lower Confidence Limit 


(a) Range Interval Method of Data Cumulation 
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Lower Confidence Limit 


(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-23 (Concluded) 



Lower Confidence Limit 


(a) Range Interval Method of Data Cumulation 


13-JUL 

-75 

EDDY CUKRENT 


TEST 

1.. ROCM'IELL 

SC> 'W 

(24) 

iNGE 

MIN LN 

M8K LN 

N 

GET 

50‘; 

95 ;; 

0 MI 

S3 1 i 

1 

* 

-k 22 

13 


12 


0 

n 


25 

... . >.,.B6 


f. 

30 

15 

0 

0 

3 

38 

52 


8 

34 

19 

0 

1,1 

4 

54 

67 

46 

10 

20 

12 

0 

1.1 

5 

68 

82 

53 

47 

87 

78 

63 

76 

6 

S3 

97 

39 

37 

93 

84 

22 

37 

? 

98 

111 

17 

17 

96 

83 

12 

29 

8 

115 

126 

17 

16 

90 

75 

29 

44 

q 

129 

141 

19 

17 

36 

70 

0 

0 

10 

143 

157 

15 

12 

76 

56 

0 

0 

11 

158 

171 

3 

3 

79 

36 

0 

0 

12 

1S2 

185 

3 

3 

79 

36 

0 

0 

13 

190 

197 


2 

70 


0 

0 

14 

0 

0 

0 

0 

0 

0 

0 

0 

15 

0 

0 

0 

0 

0 

0 

0 

0 

16 

241 

247 

4 

4 

84 

47 

0 

0 

17 

248 

262 

17 

17 

96 

§3 

12 

29 

18 

268 

275 

3 

3 

79 

36 

R 

0 

19 

279 

290 

*7 

t 

6 

l"* l’* 

47 

0 

0 

20 

295 

\i06 

6 

6 

89 

60 

0 

0 

21 

310 

322 

10 

10 

93 

74 

0 

0 

22 

323 

336 

12 

11 

86 

66 

0 

0 

23 

•AijS 

352 

11 

9 

76 

52 

0 

0 

24 

356 

362 

4 

4 

84 

47 

0 

0 

25 

370 

381 

5 

4 

68 

34 

0 

0 

26 

3S4 

393 

2 

2 

70 

00 

0 

0 

27 

408 

408 

1 

1 

50 

'"s 

0 

0 

28 

426 

426 

1 

i 

50 

5 

0 

0 

29 

442 

442 

1 

0 

0 

0 

U 

0 

30 

444 

444 

1 

1 

50 

5 

0 

0 

31 

458 

472 

8 

-> 

r 

79 

52 

0 

0 

32 

474 

979 

58 

53 

90 

82 

45 

58 


Crack Length (Mil)* 

50 100 150 200 250 300 350 400 450 



Figure D-24 Probability of Detection for 2219-T87 A1 Using 
Eddy Current. Etched Fatigue Cracks in Flat 
Plates Measured by Operator W. Lab. Env. 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-24 (Concluded) 
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Figure D-25 Probability of Detection for 2219-T87 Al Using 
Eddy Current, Etched Fatigue Cracks in Flat 
Plates Measured by Operator X, Lab. Env. 

D-75 



One Sided Lower 
Confidence Limit 
at the 95% Con- 
. fidence Level 


Crack Length (Mil) 

r\ i-k ^ ^ ^ _ 


o 


7 } 

w o«j oj f\> ro i\) fo fo ro ro fo ^ ^ S 


$S!«M§Hs»Sa'E?„iis55;*8s-is8 


^ m 


MHSSgSasaSSrc»5aS5i5=8f!sssf 


t>j r- 1- 

ro 3 7; 
7} 

K- rn 








rS ® -J1 !•: rj, y, i; a :j g JJ S g ro w « ^ 

4:> 0-i 

o 

oo®co 3ooo®“.soo.:-,u,s®c.®oc.oS,"C^Joooc.®3K 


■P> 

Ui 

o 

ro Si T-, ,r.,--, ^ ^ , 

^ -» W • J 1.' -JJ 'Zi' o l_I l^. l^t 


C«‘‘ 

v> 


Interval Method of Data Cumulation 



(b) Optimum Probability Method of Data Cumulation 
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Figure D-25 (Continued) 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-25 (Concluded) 



(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-26 (Concluded) 



(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-27 (Concluded) 
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(a) Range Interval Method of Data Cumulation 
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Lower Confidence Limit 


(b) Optimum Probability Method of Data Cumulation 
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Figure D-28 (Continued) 
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Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-28 (Concluded) 
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(a) Range Interval Method of Data Cumulation 


23-JUL-rf> 
RANGE MIN LN 


1 

2 

3 

4 

5 

6 
7 
3 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 


25 

38 

54 

68 

83 

98 

115 

129 

143 

158 

182 

190 

0 

0 

241 

248 

268 

279 

295 

310 

323 

338 

356 

378 

384 

408 

42^ 

442 

444 

4oo 

474 


RADIOGRAPH'i- 

,MAM LM , 
•k ->? "k 

\ y —.u 

52 

67 

82 

97 

ill 

126 

141 

157 

171 

185 

197 

0 

0 

247 

262 

275 

290 

306 

322 

336 

352 

362 

381 

393 

408 

426 

442 

444 

472 

979 


M 

13 

, ' 1 o 

23 

46 

53 

39 

17 

17 

19 

15 

3 

3 
2 
0 
0 

4 
17 

3 
7 
6 

10 

12 

11 

4 

5 

T 

1 

1 

1 

si 


TEST ) DSH=21, ROCKWELL iC 

DET 95L 0 MI 38 

15 0 0 


7 
9 

16 

6 

1 

3 

2 

0 

0 

1 

0 

0 

3 

16 

3 

3 

1 

3 

4 

8 
3 

5 
2 
0 
0 
1 
1 
8 

58 


3 

7 

14 

16 

39 

32 

3 

13 

10 

0 

0 

29 

0 

e 

61 

90 
79 

36 
10 
25 
29 
67 
61 

37 
70 

0 

0 

50 

50 

91 
97 


I 

16 

0 

4 

0 

0 

■? 

0 

0 

24 

I 

36 

12 

0 

s 

12 

43 

24 

54 

“o 

n 

c. 

5 

68 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

29 

ri 

li 

0 

li 

6 

0 

0 

0 

0 

0 

0 

0 

n 

*1 


D (29) 

1 MI '..3 
G 
0 
0 
0 
n 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

44 



X-ray, Etched Fatigue Cracks in Flat Plates 
Measured by Operator D. Lab. Env. 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-29 (Concluded) 




(a) Range Interval Method of Data Cumulation 
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Figure D-30 Probability of Detection for 2219-T87 Al Using 
X-ray. Etched Fatigue Cracks in Flat Plates 
Measured by Operator E. Lab, Env, 

D-90 




Lower Confidence Limit 


(b) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-31 (Concluded) 
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Fifijure D-32 (Continued) 
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(a) Range Interval Method of Data Cumulation 
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Lower Confidence Limit 


(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-34 (Continued) 


D-106 


(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-34 (Concluded) 


(a) Range Interval Method of Data Cumulation 
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Lower Confidence Limit, 
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Figure D-35 (Continued) 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulat 


<:;• 0 o ro o oo s* © o c< o o o o c- 00 C/C'omooooo 


rn 


_i2:cc>cs>cac«yiti«<&tr'OC'ir'Ooooo<S'C"Soc:'OOOO0D®':iC‘'iDO 
3 0 


O 

Cl' 


Q'7' 


;•^JOl£»o^^w©r^oo®^-®®'^ooooG>®oot^)oo^-o^DOQCO^^>m 
tr>c*j 00 ^co io>iJ 


^£> rr rv 


^ { 
.f 


O O <Ti"‘r^ '^fIOfv-Ota1iO»TMr'®K»^0000®0000^©K»S'0®®0 

or- r-.<rtO')<Tt(j\ (t^. ;co<ji. wcrt cti 00 os ouo 


u:- 


uj h- oj o CO 'O' tt ffi o o ^ ©VX 30 o o©©oorw©c>«o>o^©o(Drwr-* 

f — lU ('J ^ 


>■ 


3 04oro<P'0"0-ro©^QTr’0©jDa)0©oo©orwootf®^©©©h.^ 

. 'i ^ ‘ 


3 _iro 
0: 


or-ioojpjoooioin^O'O'fooooooo^ooiriOOTOooio© 
>0 10 'll r- S Oi o 04 ro © o •-• -O' ij*) 

^ CM OJ CM CM 


UJ'X 
3 3 
UJ 

CL ^ 


If-o 


toz 
r - 
j s: 

UJ 
I t J 
Oi3 

cM<r 

CiC 


o r - O' oj f •- m © ■^ © in ro o M- o o © o o o o M- © o lo o Wj © o o «r» o C> 

■O' in cn c£i r- cr. ©-* c'jr; © © -< ■ou's m 

^ CM CM C'J 04 


CM r-0 O' in ' o r- © © © ^^ cm ro o in 'o co Oi © «-« oj r> o- u*) 'O f'- © © © -^ cm 

»-• *-i »rt w »-t 04 Cm 04 CM C* J CM CM OJ 04 C'4 m M 


o L- 


Crack Length (Mil) * 

100 150 200 250 



Figure D-36 Probability of Detection for Ti-6A1-4V Using 

Liquid Penetrant. Fatigue Cracks in Flat Plates 

Prod, Env. 



(b) Optimum Probability Method of Data Cumulation 
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Fip;ure D -36 (Continued) 



(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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Figure D-37 Probability of Detection for Ti-6A1-4V Using 
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Figure D-37 (Continued) 
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(c) Ovetlapping Sixty Point Method of'Bata Cumulation 
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Figure D-37 (Concluded) 
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Figure D-38 Probability of Detection for Ti-6A1-4V Using 

Liquid Penetrant. Fatigue Cracks in Flat Plates 

Prod. Env. D-118 



(b) Optimum Probability Method of Data Cumulation 
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Figure D-38 (Continued) 
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(a) Range Interval Method of Data Cumulation 
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Figure D-39 Probability of Detection for Ti-6A1-4V Using 

Liquid Penetrant. Fatigue Cracks in Flat Plates. 

Prod. Env. 

D-12’1 
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(b) Optimum Probability Method of Data Cumulation 
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Figure D-39 (Continued) 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-39 (Concluded) 



(a) Range Interval Method of Data Cumulation 



Crack Length (Mil)* 

100 150 200 



r-» 

m 

v£> c 
H 

I 

m CO 
rM 

o o 


Xi 

CO • 

^ ;3 ^ 
n tr* O 


O 

I 

O 

<u 

P 

bO 

•H 



* (b) Optimum Probability Method of Data Cumulation 
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Figure D-40 (Continued) 



Figure D-40 (Concluded) 
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Figure D -41 (Conclud'^d) 




(a) Range Interval Method of Data Cumulation 
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Figure D-42 Probability of Detection for 7075-T6511 A1 Using 
Liquid Penetrant. Fatigue Cracks in Flat Plates. 

Prod, Env, D-ISO 
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Point Method of Data Cumulation 
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Figure D-42 (Concluded) 




Interval Method of Data Cumulation 
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Figure D-43 (Continued) 
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Figure D-43 (Concluded) 
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(c) Overlapping Sixty Point Method of Data Cumulation 



(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Ciimulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumtilatlon 




Crack Length cm 

Figure D-46 Probability of Detection for PH17-4 Steel Using 

Ultrasonic Shear Wave. Simulated Flaws in Wrought 
Steel. Prod. Env. 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 


09-0CT-?5 


ULTRASONIC 


TEST 


(46) 


0 




MGE 

MIN LN 

^MAX LM ^ 

U 

DET. 

50*-; 


0 MISS 

1 1 

1 

0 

0 

0 

0 

0 

0 

0 


0, 

0^' ' 

' 0 

0 

0 

0 

' 0 

0 

3 

0 

' 0 

0 


0 

0 


'0 

4 

0 

0 

0 


0 

.0 

riT 0-': ■ 

CiO 

5 

0 

0 

0 

6 

0 

0 

■ . 0 

.. 0 

6 

0 

0 

0 

0 

■ 

■0' 


0 

7 

0 

0 

0 

- 0 

.:0'- 

0 

0 - 

0 

8 

0 

0 

0 

0 

0 

0' 

0 

0 

9 

0 

0 

0 

0 

.0 

0 

6 

0 

10 

0 

0 

0 

0 

0 

0 

0 

0 

11 

0 

0 

0 

0 

0 

0 

0 

0 

12 

0 

0 

0 

0 

0 

0 

0 

0 

13 

0 

0 

0 

0 

0 

0 

0 

0 

14 

0 

0 

0 

0 

0 

0 

0 

0 

15 

0 

0 

0 

0 

0 

0 

0 

0 

16 

0 

. 0 

0 

0 

0 

0 

0 

0 

17 

0 

0 

0 

0 

0 

0 

0 

0 

IS 

0 

0 

0 

0 

0 

0 

0 

0 

IS 

0 

0 

0 

0 

0 

0 

0 

0 

20 

0 

0 

0 

0 

0 

0 

0 

0 

21 

0 

0 

0 

0 

0 

0 

n 

0 

22 

0 

0 

0 

0 

0 

0 

0 

0 

23 

0 

0 

0 

0 

0 

0 

0 

0 

24 

0 

0 

0 

0 

0 

0 

0 

0 

25 

0 

0 

0 

8 

0 

0 

0 

0 

26 

0 

0 

0 

0 

0 

0 

0 

0 

27 

0 

0 

0 

0 

0 

0 

0 

0 

28 

0 

0 

0 

0 

0 

0 

0 

0 

29 

0 

0 

0 

0 

0 

0 

j 

0 - 

30 

58 

98 

41 

41 

98 

Q2 

0 

5 

31 

67 

117 

60 

60 

98 

95 

0 

0 

32 

93 

215 

50 

60 60 
Crack Length 

98 95 

(Mil)^'^ 

100 

0 

0 

1! 


sol 


r-«04- 

fL 


70.. 

60-. 

50 -. 

40-. 

30-. 

20l 

10 


0 


One Sided Lower 
Confidence Limit 
at the 95% Con- 
fidence Level 


.1 




.3 


Crack Length cm 
Figure D-46 (Concluded) 


D-144 



Lower Confidence Limit 


(a) Range Interval Method of Data Cumulatioh 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-47 (Concluded) 
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Figure D-49 Probability of Detection for ^33°^ . , 

Liquid Penetrant. Fatigue Cracks in Cylindrical 

Shell Specimens. Lab. Env. 

D-153 

' t 



Crack Length (Mils)* 

100 200 300 400 500 


One Sided Lower 
Confidence Limit 
at the 957o Con- 
fidence Level 



Figure D-49 (Continued) 
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Figure D -49 (Concluded) 




Lower Confidence Limit 


(a) Range Interval Method of Data Cumulation 
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Lower Confidence Limit 


(b) Optimum Probability Method of Data Cumulation 
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Lower Confidence Limit 


(c)';' Overlapping Sixty Point Method of Data Cumulation 
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(b) Optimiam Probability Method of Data Cumulation 
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Figure D-51 (Concluded) 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(b) Overlapping Sixty Point Method of Data Cumulation 
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Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-52 (Concluded) 
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(a) Range Interval Method of Data Cumulation 


■i* 


to 

c 



) 




■Confidence Limit 


(b) Optimum Probability Method of Data Cumulation 


10-OCT-rs 

RrtNGE MIN LN 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 

16 
1 ? 
18 

19 

20 
21 
22 ' 

23 

24 

25 

26 
2? 
28 

29 

30 

31 

32 


70 

.0 

70 

70 

130 

130 

130 

130 

150 

130 

150 

150 

0 

150 

0 

150 

e 

150 

0 

150 

0 

150 

0 

150 

150 

0 

0 

150 

150 

0 

150 

150 


* 


ULTRASONIC 
mx LN . 
70 * 
0 . 
105 
120 
140 
150 
158 
170 
190 
200 
215 


N 

1 

0 

5 

7 

10 

12 

17 

18 
11 
23 
15 


TEST 

DET 

I 

0 

3 

4 
8 

10 

15 

16 
11 
20 
14 


50*^ 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
9 


C53) 


5 

0 

18 

22 

49 

56 

67 

68 
76 
69 


0 mss 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 


1 mss 
0 
0 
0 
0 
O 
0 
0 
0 
0 
0 



236 

22 

21 

0 

80 

24 

39 

0 

0 

0 

0 

0 

0 

0 

264 

26 

25 

0 

83 

20 

35 

0 

0 

0 

0 

0 

0 

0 

292 

31 

30 

0 

85 

15 

30 

0 

0 

0 

0 

0 

0 

0 

315 

34 

33 

0 

86 

12 

27 

0 

0 

0 

0 

0 

0 

0 

344 

39 

37 

0 

84 

;>*> 

37 

0 

0 

0 

0 

0 

0 

0 

368" 

40 

38 

0 

85 

21 

.36 

e 

0 

0 

0 

0 

9 

0 

394 

42 

40 

0 

85 

19 

34 

420 

43 

41 

0 

86 

IS 

33 

0 

0 

0 

0 

0 

0 

0 

0 

0 

. 0 

0 

0 

0 

0 

460 

44 

42 

0 

86 

17 

32 

473 

46 

44 

0 

86 

« C‘ 
k 

30 

0 

0 

0 

0 

0 

0 

0 

499 

47 

45 

0 

87 

14 

29 

526 

43 

46 

0 

87 

13 

23 


Crack 

Length 

(Mils)* 



— ) 

200 

— 1 

300 

■> 1 — 

1 — 

400 

"1 

-H 

500 




One Sided Lower 
Confidence Limit 
at the 95% Con- 
fidence Level 


0 .1 .2 
Figure D-53 (Contlnuea) 


.3 .4 .5 .6 .7 .8 .9 1 1.1 1.2 1.3 

Crack Length cm 




D-166 


Ji,-iT;PRODUCIBILlTY OF THE 
PAGE IS POOR 



(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-53 (Concluded) 
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(a) Range Interval Method of Data Cumulation 


0 


•p^ 

i! 

$ 

o 

c 

(U 

•rl 

C 

. o 

o 

u 

0) 

3 

3 


90. 

80. . 

70. . 
80 . 

50.. 

40.. 

30.. 

20 .. 
10 .. 

0 


0-OCT 

-75 RADIOGRAPHY 


TEST 1 ' 

.(56) 


INGE 

MIN LN . 

MAX LN 


N 

DET 

50?': 95 : ? 

i MIS; 

1 

70 * 

70 

if 

1 

0 

0 

0 

0 


0 

■, 0 


0 

0 

0 

0 

0 

3 

100 ' 

705 


4 ‘ 

0 

0 

0 

0 

4 

120 

120 


2 

0 

0 

0 

0 

5 

130 

140 


11 

0 

0 

0 

0 

6 

150 

150 


2 

0 

0 

0 

0 

7 

157 

158 


5 

C 

0 

0 

0 

S 

170 

170 


1 

0 

0 

0 

0 

Q 

184 

190 


3 

. 0 

0 

0 

0 

10 

200 

200 


2 

0 

0 

0 

0 

11 

212 

215 


2 

0 

0 

0 

0 

12 

236 

236 


7 

0 

0 

0 

0 

13 

0 

0 


0 

0 

0 

0 

0 

14 

262 

264 


4 

1 

15 

1 

0 

15 

0 

0 


0 

0 

0 

0 

0 

16 

288 

292 


5 

0 

0 

0 

0 

17 

0 

0 


0 

0 

0 

0 

0 

18 

314 

315 


3 

0 

0 

0 

0 

19 

0 

0 


0 

0 

0 

0 

0 

20 

337 

344 


5 

1 

12 

1 

0 

21 

0 

0 


0 

0 

0 

0 

0 

22 

368 

368 


1 

0 

0 

0 

0 

23 

0 

0 


0 

0 

0 

0 

0 

24 

394 

394 


2 

0 

0 

0 

0 

25 

420 

420 


1 

0 

0 

0 

0 

26 

0 

0 


0 

Q 

0 

0 

0 

27 

446 

446 


1 

0 

0 

0 

0 

28 

0 

0 


0 

0 

0 

0 

0 

29 

472 

473 


2 

1 

29 


0 

30 

0 

0 


9 

0 

0 

0 

0 

31 

499 

499 


1 

1 

50 

5 

0 

"70 

526 

526 


1 

1 

50 

5 

n 




Crack Length 

(Mils) * 




100 

f t — 

! 

200 
f • 

1 " 

300 
1 — 

400 

1 ' ' T- 

— r~ 

50 


1 mss 
0 
fl 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
u 
0 
6 
rt 
0 
0 
..i 
0 
0 
0 


One Sided Lower 
Confidence Limit 
at the 95% Con- 
fidence Level 


j- 


0 >1 .2 


~A .5 .6 .7 .8 .9 1 1.1 1.2 1.3 

Crack Length cm 


uin^ 


Figure D-56 Probability of Detection for 4330y Steel Using 
X-ray. Fatigue Cracks in Cylindrical Shell. 
Lab , Env . 


n_ 1 7 /. 




0 


Pu| 

XJ 

nf4 

J 

hJ 

0 

O 

(U 

-a 

•rH 

M-4 

ci 

O 

u 

<u 


90 

80 

70 

60. 

50.. 

40.. 

30.. 

20 .. 
10 .. 


(b) 

Optimum Probability Method of 

Data 

Cumulation 

lO-OCT 

-75 

RADIOGRAPHY 

TEST 

2 


(56) 



^NGE 

MIN LN 

*MAX LN* 
70 

N 

DET 

507. 

95Z 

G 

1 MISS 

l MISS 

1 

70 

1 

0 

0 

0 


0 

0 

2 

0 

^ 0 . 

\ ' 0 

0 

0 

0 


0 

n 

3 

100 

105 

4 

0 

0 

0 


0 

0 

4 

120 

120 

2 

0 

0 

0 


0 

0 

5 

130 

140 

11 

0 

0 

0 


0 

0 

6 

150 

150 

2 

0 

0 

0 


0 

0 

7 

157 

158 

5 

0 

0 

0 


0 

0 

S 

170 

170 

1 

0 

0 

0 


0 

0 

9 

184 

190 

3 

0 

0 

0 


0 

0 

10 

200 

200 

2 

0 

0 

0 


0 

0 

11 

212 

215 

2 

0 

0 

0 


0 

0 

12 

236 

236 

7 

0 

0 

0 


0 

0 

13 

0 

0 

0 

0 

0 

0 


0 

0 

14 

262 

264 

4 

1 

0 

1 


0 

0 

15 

0 

0 

e 

0 

0 

0 


0 

0 

16 

262 

292 

9 

1 

0 

0 


0 

0 

17 

0 

0 

0 

0 

0 

0 


0 

0 

18 

262 

315 

12 

1 

0 

0 


0 

0 

19 

0 

0 

0 

0 

0 

0 


0 

0 

20 

262 

344 

17 

2 

0 

2 


0 

0 

21 

0 

0 

0 

0 

0 

0 


0 

0 

22 

262 

368 

18 

2 

0 

2 


0 

0 

23 

0 

0 

a 

0 

0 

0 


0 

0 

24 

262 

394 

20 

2 

0 

1 


0 

0 

25 

262 

420 

21 

2 

0 

1 


0 

0 

26 

0 

0 

0 

0 

0 

0 


0 

0 

27 

262 

446 

22 

2 

0 

1 


0 

0 

28 

0 

0 

0 

0 

0 

0 


0 

0 

29 

262 

473 

24 

3 

0 

3 


0 

0 

30 

0 

0 

0 

0 

0 

n 


0 

0 

31 

472 

499 

3 

2 

0 

13 


0 

0 

32 

472 

526 

4 

3 

0 

24 


0 

0 




Crack Length 

(Mils)* 




1 

100 

200 

300 


400 


500 



“» 

^ f 

-H h- 

1 — 

— 1 — 

1 

— 

1 — 

1 


One Sided Lower 
Confidence Limit 
at the 95% Con- 
fidence Level 



0 *1 .2 .3 


.5 .6 .7 .8 .9 

Crack Length cm 


1 1.1 1.2 1.3 


Figure D-56 (Continued) 


D-175 




(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Figure D-59 (Continued) 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optiimam Probability Method of Data Ciimulation 
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Figure D-60 (Continued) 



(c) Overlapping Sixty Point Method of .Data Cumulation 
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Figure D-60 (Concluded) 
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Figure D-61 Probability of Detection for 4340M Steel Using 
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(b) Optimum Probability Method of Data Cumulation 



Figure D-61 (Continued) 
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Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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optimum Probability Method of Data Cumulation 
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Figure D-63 (Concluded) 



(a) Range Interval Method of Data Cumulation 





(b) Optimum Probability Method of Data Cumulation 
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Figure D-64 (Continued) 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Figure D-65 (Continued) 



(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-65 (Concluded) 


Lower Confidence Limit 


(a) Range Interval Method of Data Cumulation 
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Figure D^66 Probability of Detection for 4340M Steel Using 
Liquid Penetrant. Compressed Notch Flaws in 
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(b) Optimum Probability Mdrthod of Data Cumulation 


V.* 

I— « 

SZ 

O C» ® O O *X* Oi r- <S> CO ^ O © O © O O O O O © © O © 1 » © © 'll 

o 

C*. 

to vt 

»— 4 

^ *S* 'S' 'S' tj^ O O <F'i IT* O 'S' O (SI' G* O O O 'S' © O © S' S' O S' O © S 'll S’ © 'I' 

^ O O 

'S o 

<r 

v; 

X -r r- c*:* o ’jcm o o •■£> w .© o oj ro r**) n- ^ S' u*' o in tn '£■© © o s* © S"© 'O 

© ©©«7i <r» (Ti <T» <y» <y> <?ii cv O'ttTt^Tt q 

’ in 

cn 


.'■■* <S> S' S' © •© © © O S' S' © © S' © © O © Q © © ©©S' ©©©©©©©©©« 

AJ**' ✓-sO 

to O 

*7 r-l m 

lO • 

uj*— '^co©r'oasoc:iprfa>©-tfcocvi*.oO'^©©oj©N*-«iOO®®®©oo'T>»S 

»-'jd wojoj foro-^^inioiD ai> ivS 

tJ O 

in 
JC CM 
4 J 

bo 

X ' 4 ’ 0 :"©Nr^©©O'f <ri©^©oj'X'©-^©©(vj©N«-'ir>®® ®o®®©<^ C O 

foir* OJMM to IDNN. tv U O 

1-3 CM 


l 3 lg® 2 g®®S 2 S® 8 gg 2 ?gg® 2 ®g§ 8 ® ^■,,,^ 

i;., ^ojfM ?j cj to ro w w p 7 .c,U 


u 

CO o 

© o © S' © © 'S' u m 

0 *^ 


til, 

H- 

UJ s 

X©00©©00©©©©©© S' ©©©©©© ©©©©©©O©© S' S"t* 

rr-* rmf> i-orororonrow w fowro lo 

^ w» m* ■mm ^ mm mm *-M 

JT'Z 
f - •— 

t c 
►» 

^uj-<rjfo^in'^K©af©-M0ir«)Tfir)u)K(o9^i©— tMr>^iptcNcciCh®'Mfj 

^ M OJ CM 04 CJ 04 rj CM Fi Ki JO 


o 

o 


o 

in 



4 J 
)-i *H 

Q) 

•X 3 O 
® C 
■U (U 
•i-l *o 
C /3 «H 
4-1 

(U C 

C O 
O U 


I 

c 

O r-« 
O (U 

<u 

m M 

CTN 

0 ) o 

c 

4 J 0 ) 
*0 
4 J «H 
(0 4 M 


^ i ^ i t ^ f 

‘ij'puTf'i aouap*tjuoo jawcrx 


CM 


O' B 

• u 


GO 42 

• 4 J 
Oi 
C 

fv <0 

• ^ 

VO u 

• m 

M 

O 

in 


fO 


CM 


m 

O 

CM 

I 

Q 


O 


Figure D*66 (Continued) 



(c) Overlapping Sixty Point Method of Data Ctimulation 
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Figure D-66 (Concluded) 
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(a) Range Interval Method of Data Cumulat 



(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-67 (Concluded) 
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Figure D-68 Probability of Detection for 4340M Steel Using 
Liquid Penetrant. Compressed Notch Flaws in 
~ Filleted Hollow Cylinder. Lab. Env. 
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(b) Optimum Probability Method of Data Cumulation 



Figure D-68 (Continued) 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-68 (Concluded) 




(a) Range Interval Method of Data Cumulation 
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Figure D-69 Probability of Detection for 4340M Steel Using 
Liquid Penetrant, Compressed Notch Flaws in 
Filleted Solid Cylinder. Lab, Env. 
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(b) Optitmin Probability Method of Data Cumulation 



Figure D-69 (Continued) 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-69 (Concluded) 
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(a) Range Interval Method of Data Cumulation 
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Figure D-70 Probability of Detection for 4340M Steel Using 
Liquid Penetrant, Compressed Notch Flaws in 
' Filleted Solid Cylinder. Lab, Env* 
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(b) Optimum Probability Method of Data Cumulation 


O «S> O O O O ® © O (S O f 


wZ=©©0000©©0©0©0©©0©©©q^qCI>oqq^Oqq G ©< 


ly, « 


,ir’® ® ® ® ® ® ®® ® ® ® ® ®®0©00® 0000©©0 ©I 

' uS 

r*i 


JIj ' ^ ® Rj M M n ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ' 

Cl 


® oj f£) ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® ® © ® ® 


^ 5 ^^®^®S®o®®®®®®®®®®® ®®®®®®®®®®® ® 

CiC -w-f AJ 

»-x 

Uj-rrr j; 

5 ®^®®®®®®®®®®®®®®®®®®®®®®®®®®®©© 


^ <\j ro i«- in <o tv © <Tk o (V •^riTj «r» fw © cn o 4M r) -«■ r> VO N ©<r» © <-* M 

|.^g ■•-I 1-t (Mt^AKVj w w wojcvjw row ro 


O 


idfl 7^a 43 43 e 93 0 3 

Crack Length (Mils)* 

100 200 300 400 500 600 700 800 



Figure D-70 (Continued) . 




Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-70 (Concluded) 
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(a) Range Interval Method of Data Cumulation 
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Figure D-71 Probability of Detection for 2024-T6 A1 for Ultrasonic 
Shear and Surface Waves. Compressed Notch Flaws in 
Tandem T. Prod. Env. 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Oveflappitig Sixty Point Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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Lower Confidence Limit 


(b) Optimum Probability Method of Data Cumulation 
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Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-75 (Concluded) 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Figure D-76 (Continued) 



(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimtim Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure b - 77 (Concluded) 




(a) Range Interval Method of Data Cumulation 
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Figure D-78 Probability of Detection for 4340M Steel Using 
Ultrasonic Shear and Surface Waves. Compressed 
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(b) Optimum Probability Method of Data Cumulation 
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Figure D-78 (Continued) 


Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-78 (Concluded) 


D-242 


rsPBi 


Tr:.'!'Ki AIj 




(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Figure D-79 (Continued) 




(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-79 (Concluded) 


D-145 



Lower Confidence Limit 


(a) Range Interval Method of Data Cumulation 
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Figure D-80 Probability of Detection for 4340M Stedl Using 
Ultrasonic Shear and Surface Waves. Compressed 

Notch Flaws in Filleted Hollow Cylinder. Lab. Env. 





Lower Confidence Limit 


(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Figure D-81 (Continued) 



(c) Overlapping Sixty Point Method of Data Cumulation 
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Figure D-81 (Concluded) 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 




(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 


range min 
1 
2 

3 

4 

5 


S 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

7?> 


0 


90l 

t-i 

PA 

^ 80. 

4J 

•H 

.§ 70, 

•H 

QJ 60. 

o 

C 

o 
•u 

•H 

g 

u 

u 30 
0) 

5 

S 20 ' 


50i 


404- 


10 


LH 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

100 


radiography 
* * 

.-31, 


0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

390 

Crack 


N 

0 

. 0 
0 
0 
0 
0 
0 
0 
e 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
e 
0 
0 
0 
0 
0 
3S 


TEST 

DF.T 

0 

0 

0 

0 

0 

0 

0 

0 . 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
9 
0 
0 
0 
0 
0 
0 
16 


50*i 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

40 


951 


r 


e 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

28 


(84) 

0 MISS 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
u 
0 
0 
0 


I HISS 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
n 
0 
0 
0 
0 
0 
0 
0 
0 


50 100 150 


Length (Mils)* 
200 250 300 


350 400 450 


One Sided Lower 
Confidence Limit 
at the 957p Con- 
fidence Level 


0 .1 


.3 


.5 .6 .7 .8 ,9 

Crack Length cm 


1.1 1.2 


figure D-84 (Concluded) 


Dr. 2 60 




Figure D-85 


Probability of Detection for 4340M Steel Using X-ray. 
Con«)res8ed Notch Flaws in Hollow Filleted Cylinder. 

Prod. Env. 

D-261 




Lower Confidence Limit 


(b) Optimtjm Probability Method of Data Cumulation 



Figure D- 85 (Continued) 


- ^peoducibility of the 

p^eE IS POOR 




(c) Overlapping Sixty Point Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 


RADIOGPhPHV 


RANGE 

1 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 


0 


Pm 


90.. 

< 

80. 

70.. 

60.. 

50.. 

40.. 


MIN LN . 

LM 

100^ 

110 ^ 

e 

. 0' 

0 

0 

0 

0 

0 

0 

100 

190 

0 

0 

100* 

230 

100 

250 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

100 

350 

0 

0 

100 

380 

0 

0 

0 

0 

0 

0 

100 

460 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

380 

650 

100 

— 

200 

» 1 


H 

.'0 

0 

0 

0 

4 
0 

5 

6 
0 
0 
0 
0 
0 

7 
0 

8 
0 
0 
0 

10 

0 

0 

0 

6 

6 

0 

0 

0 

0 

0 

4 


TEST 
. DET 

1 

0 

0 

0 

0 

2 

0 

2 

2 

0 

0 

0 

0 

0 

2 

0 

3 
0 
0 
0 

4 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
3 


Crack Length 
300 400 

-A- — I 1— — h- 


50^ 

0 

0 

0 

0 

0 

0 

0 

- ■ 0 ... 

0 ' 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

(Mils) * 
500 

— I ►— 


95^; 

1 

0 

0 

0 

0 

9 

0 


f 

6 

0 

0 

0 

0 

0 

5 

0 

U 

0 

0 

0 

IS 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

24 


(86) 

0 MIS:i 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 


600 

— t- 


One Sided Lower 
Confidence Limit 
at the 95% Con- 
fidence Level 


l MISS 
0 
0 
0 
0 
0 . 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

►jt 

0 

0 

0 


700 



.6 .8 1 1.2 1-4 

Crack Length cm 


Figure D-86 (Continued) 


I- 


D-'265 




(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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Lower Confidence Limit 


(a) Range Interval Method of Data Cumulation 
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(b) Optitnum Probability Method of Data Cumulation 



^Figure D-90 (Continued) 


D-277 




Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Curhulation 
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(b) Optimxnn Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 



(b) Optimum Probability Method of Data Cumulation 
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Figure D-92 (Continued) 



(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 



Ftgu'te . Dr93., CContlM^ 

D-286 EEPRODUCIBILITy OF 'iHii 
ORIGINAL PAGE IS POOR 




(c) Overlapping Sixty Point Method of Data Cumulation 


27-0CT-75 
R^)NGE MIN 
1 
2 

3 

4 

5 
B 

7 

8 
9 

t0 

n 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 


LN 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 




MAGNETIC 
,NhN LN, 
0 

> 0; 

0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 


PhRTICLE 

* 

0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 


TEST 

DET 

0 

0 

0 

8 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


50*. 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 


0 

0 

0 

e 

e 

30 

70 

42 

36 

84 

50 

130 

60 

58 

95 

70 

140 

60 

60 

Q8 

130 

200 

60 

60 

SS 


95 *^ 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

6 

0 

0 

73 

89 

95 


( 93 ) 

0 MISS 
0 
0 
0 
0 
6 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
-0 
1 
0 


Crack Length (Mils)* 


1 MISS 
0 
0 
0 
0 
n 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 

16 

0 



D-287 



(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(b) Optimimi Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(b) Optimim Probability Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cunmlation 
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Lower Confidence Limit 


(b) Optimturi Probability Method of Data Cumulation 



Figure D-lOO (Continued). 
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Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Figure D- 101 (Continued) _ 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Ctunulation 


to 


oj ^ i^j *’ ^ ^ ® ® ® o G* o o o o o '3 c* C' o o o o o 

G* ® OOG)<DOC?OG»S'0(SOOO<50C'=?5Cr'3G> 


O'* 

s: »■■ 


O 

o 

vO 


O 
Of 
»o 


CTi 


•JC o 




. »1-l 

5 

^ J 3 

U O 
WO 
d cn 
(0 

y -1. ^ (y-,cOCM.MC?OroOOQO>-«OCD ’♦'©»-« 0®<SMS*0 00C*0fS 1-1 ^ ^ 

b’ 

•r ^ 

«It. 0} 

I M 0 + 

^ *j€ O O 

[]].,. cj MM 

I J! 21 


to") 


JT* 
f _ ^ 
»— ^ 
O 


^ ^ ^ ^ ^ ^ 04 |V) M M 1,5 


O 

0 + 


o UJ rg M in ^ r - at Ch O »-t OJ M IT) •£< rw a< (T> ® ^ W M ti- If) tu fv. CD cry CD -• i-g 
*^»-«»-'-*-*^»-*^^^Cij(\jOJPk|fM0«J rvj fu tM w M M M 


wz 

fj<x 


-I ^ 


4 - 1 - 


^ ^ S lO ^ 


O C o 
M 


■f 


© 


d; ‘^Turtl 0DU9pTjuo3 asMcrj 





QD 

a> 

r -4 

O 

•H 

Li 

d 

Pw 


4 J 

(U 

d 

w 


> 

d 


6 

cs o 


-p 

O' 

d 

QJ 

^A 

O 

ro 

CO u 

• u 


-+AD 


CM 


W=» 

v-J 

03 

D • 

p 

tH cu 
Q) 'O 
CU d 
4J *H 
CO i-< 

jS U 
! O 
-<f 15 
cn o 

t-H 

•-<. CN 
Li O rH 
O Ixl CO 

r. ' 
w <=» 

d *H 

o 

•H CO 

•P 5 
O tc 
cu r-i 
4J fz, 

Q) 

Q x: 
o 

4 ^ 4 -> 

O O 

4J »0 

•i4 CU 
I— J 03 
•H 03 
X Q) 

Ctf P 

X a 

p g 
p o 

P4 o 


CM 

O 

r-t 

I 

P 

CU 

Li 

d 

W) 

•H 


(b) Optimtm Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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Lower Confidence Limit 


(b) Optimum Probability Method oiff Data Cumulation 
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(c) Overlapping Sistty Point Method of Data Cumulation 
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Lower Confidence Limit 


(a) Range Interval Method of Data Cumulation 
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Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(b) Optimum Prdbability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulatio 
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(a) Range Interval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Intetval Method of Data Cumulation 
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(b) Optimum Probability Method of Data Cumulation 
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Figure p- 10 


(c) Overlapping Sixty Point Method of Data Cumulation 


o 


Crack Length (Mil)* 

100 150 200 250 300 



Flgiite D- 10^ lude d) 


(a) Range Interval Method of Data Cumulation 
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(b) Optimuim Probability Method of Data Cumulation 
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(c) Overlapping Sixty Point Method of Data Cumulation 
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(a) Range Interval Method of Data Cumulation 
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Figure ' D- 111 (Cont inued) 



Lower Confidence Limit 


(c) Overlapping Sixty Point Method of Data Cumulation 



Figure D- 111 (Concluded) 
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(a) Range Interval Method of Data Cumulation 
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Figure D-il/ (Continued) 
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